Jun 25 04:38:30.221899 np0000003587 systemd[1]: Started devstack@n-cpu.service - Devstack devstack@n-cpu.service. Jun 25 04:38:31.815069 np0000003587 nova-compute[98952]: DEBUG os_vif [-] Loaded VIF plugin class '' with name 'noop' {{(pid=98952) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}} Jun 25 04:38:31.815786 np0000003587 nova-compute[98952]: DEBUG os_vif [-] Loaded VIF plugin class '' with name 'ovs' {{(pid=98952) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}} Jun 25 04:38:31.815786 np0000003587 nova-compute[98952]: INFO os_vif [-] Loaded VIF plugins: noop, ovs Jun 25 04:38:31.941818 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:38:31.951194 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.009s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:38:31.994634 np0000003587 nova-compute[98952]: INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative Jun 25 04:38:32.714099 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] In native threading mode the number of concurrent builds, and snapshots should be limited to the same number. The current configuration has differing limits: max_concurrent_builds: 10, max_concurrent_snapshots: 5. Nova will use a single, overall limit of 10 for these tasks. Jun 25 04:38:32.714229 np0000003587 nova-compute[98952]: INFO nova.utils [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] The long task thread pool MainProcess.long_task is initialized Jun 25 04:38:32.714498 np0000003587 nova-compute[98952]: INFO nova.virt.driver [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Loading compute driver 'libvirt.LibvirtDriver' Jun 25 04:38:32.912437 np0000003587 nova-compute[98952]: INFO nova.compute.provider_config [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access. Jun 25 04:38:33.414440 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Acquiring lock "singleton_lock" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:38:33.414578 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Acquired lock "singleton_lock" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:38:33.414749 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Releasing lock "singleton_lock" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:38:33.414927 np0000003587 nova-compute[98952]: WARNING oslo_service.backend._threading.service [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] no_fork=True: running service in main process Jun 25 04:38:33.415178 np0000003587 nova-compute[98952]: INFO nova.service [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Starting compute node (version 33.1.0) Jun 25 04:38:33.917809 np0000003587 nova-compute[98952]: INFO nova.utils [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] The default thread pool MainProcess.default is initialized Jun 25 04:38:33.918235 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:38:33.918436 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Starting event thread {{(pid=98952) start /opt/stack/nova/nova/virt/libvirt/host.py:251}} Jun 25 04:38:33.918734 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Starting connection event dispatch thread {{(pid=98952) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:552}} Jun 25 04:38:33.919933 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Connecting to libvirt: qemu:///system {{(pid=98952) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:557}} Jun 25 04:38:34.987134 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Registering for lifecycle events {{(pid=98952) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:563}} Jun 25 04:38:34.988707 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Registering for connection events: {{(pid=98952) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:584}} Jun 25 04:38:34.989340 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Connection event '1' reason 'None' Jun 25 04:38:35.491851 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Cannot update service status on host "np0000003587" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000003587 could not be found. Jun 25 04:38:35.491980 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.mount [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Initialising _HostMountState generation 0 {{(pid=98952) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}} Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host capabilities Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: 2a1feb13-40e2-4ac6-989e-b08a6fc0f283 Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: x86_64 Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: EPYC-Milan Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: AMD Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: tcp Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: rdma Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.406709 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: 65844276 Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: 16461069 Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: 0 Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: 0 Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408162 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: apparmor Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: 0 Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: dac Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: 0 Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: +64055:+993 Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: +64055:+993 Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: hvm Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: 64 Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-alpha Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: clipper Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: hvm Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: 32 Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-arm Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: virt-8.2 Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: virt Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: qcom-dc-scm-v1-bmc Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: mori-bmc Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: ast2600-evb Jun 25 04:38:45.408786 np0000003587 nova-compute[98952]: borzoi Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: tiogapass-bmc Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: spitz Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: virt-2.7 Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: nuri Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: mcimx7d-sabre Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: romulus-bmc Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: virt-3.0 Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: virt-5.0 Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: npcm750-evb Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: virt-2.10 Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: rainier-bmc Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: mps3-an547 Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: musca-b1 Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: realview-pbx-a9 Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: versatileab Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: kzm Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: virt-2.8 Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: fby35-bmc Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: musca-a Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: virt-3.1 Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: mcimx6ul-evk Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: virt-5.1 Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: smdkc210 Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: sx1 Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: virt-2.11 Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: imx25-pdk Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: stm32vldiscovery Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: virt-2.9 Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: orangepi-pc Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: quanta-q71l-bmc Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: z2 Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: virt-5.2 Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: xilinx-zynq-a9 Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: tosa Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: mps2-an500 Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: virt-2.12 Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: mps2-an521 Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: sabrelite Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: mps2-an511 Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: canon-a1100 Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: realview-eb Jun 25 04:38:45.410992 np0000003587 nova-compute[98952]: quanta-gbs-bmc Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: emcraft-sf2 Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: realview-pb-a8 Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: yosemitev2-bmc Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: virt-7.0 Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: virt-4.0 Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: raspi1ap Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: palmetto-bmc Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: sx1-v1 Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: n810 Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: g220a-bmc Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: n800 Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: bletchley-bmc Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: virt-7.1 Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: tacoma-bmc Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: virt-4.1 Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: quanta-gsj Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: versatilepb Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: terrier Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: mainstone Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: realview-eb-mpcore Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: integratorcp Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: virt-7.2 Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: supermicrox11-bmc Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: virt-4.2 Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: witherspoon-bmc Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: qcom-firework-bmc Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: mps3-an524 Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: kudo-bmc Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: vexpress-a9 Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: midway Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: musicpal Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: lm3s811evb Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: lm3s6965evb Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: supermicro-x11spi-bmc Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: microbit Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: fby35 Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: mps2-an505 Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: mps2-an385 Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: virt-6.0 Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: virt-8.0 Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: cubieboard Jun 25 04:38:45.414816 np0000003587 nova-compute[98952]: ast1030-evb Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: verdex Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: bpim2u Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: netduino2 Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: mps2-an386 Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: olimex-stm32-h405 Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: virt-6.1 Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: virt-8.1 Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: raspi2b Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: vexpress-a15 Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: fuji-bmc Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: virt-6.2 Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: sonorapass-bmc Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: cheetah Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: virt-2.6 Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: ast2500-evb Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: highbank Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: akita Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: connex Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: netduinoplus2 Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: collie Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: raspi0 Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: fp5280g2-bmc Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: hvm Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: 32 Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-arm Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: virt-8.2 Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: virt Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: qcom-dc-scm-v1-bmc Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: mori-bmc Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: ast2600-evb Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: borzoi Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: tiogapass-bmc Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: spitz Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: virt-2.7 Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: nuri Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: mcimx7d-sabre Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: romulus-bmc Jun 25 04:38:45.415540 np0000003587 nova-compute[98952]: virt-3.0 Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: virt-5.0 Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: npcm750-evb Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: virt-2.10 Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: rainier-bmc Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: mps3-an547 Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: musca-b1 Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: realview-pbx-a9 Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: versatileab Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: kzm Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: virt-2.8 Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: fby35-bmc Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: musca-a Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: virt-3.1 Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: mcimx6ul-evk Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: virt-5.1 Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: smdkc210 Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: sx1 Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: virt-2.11 Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: imx25-pdk Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: stm32vldiscovery Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: virt-2.9 Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: orangepi-pc Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: quanta-q71l-bmc Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: z2 Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: virt-5.2 Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: xilinx-zynq-a9 Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: tosa Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: mps2-an500 Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: virt-2.12 Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: mps2-an521 Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: sabrelite Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: mps2-an511 Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: canon-a1100 Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: realview-eb Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: quanta-gbs-bmc Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: emcraft-sf2 Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: realview-pb-a8 Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: yosemitev2-bmc Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: virt-7.0 Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: virt-4.0 Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: raspi1ap Jun 25 04:38:45.416754 np0000003587 nova-compute[98952]: palmetto-bmc Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: sx1-v1 Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: n810 Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: g220a-bmc Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: n800 Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: bletchley-bmc Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: virt-7.1 Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: tacoma-bmc Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: virt-4.1 Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: quanta-gsj Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: versatilepb Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: terrier Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: mainstone Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: realview-eb-mpcore Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: integratorcp Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: virt-7.2 Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: supermicrox11-bmc Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: virt-4.2 Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: witherspoon-bmc Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: qcom-firework-bmc Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: mps3-an524 Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: kudo-bmc Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: vexpress-a9 Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: midway Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: musicpal Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: lm3s811evb Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: lm3s6965evb Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: supermicro-x11spi-bmc Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: microbit Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: fby35 Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: mps2-an505 Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: mps2-an385 Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: virt-6.0 Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: virt-8.0 Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: cubieboard Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: ast1030-evb Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: verdex Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: bpim2u Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: netduino2 Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: mps2-an386 Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: olimex-stm32-h405 Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: virt-6.1 Jun 25 04:38:45.417476 np0000003587 nova-compute[98952]: virt-8.1 Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: raspi2b Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: vexpress-a15 Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: fuji-bmc Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: virt-6.2 Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: sonorapass-bmc Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: cheetah Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: virt-2.6 Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: ast2500-evb Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: highbank Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: akita Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: connex Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: netduinoplus2 Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: collie Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: raspi0 Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: fp5280g2-bmc Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: hvm Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: 64 Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-aarch64 Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: virt-8.2 Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: virt Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: qcom-dc-scm-v1-bmc Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: mori-bmc Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: ast2600-evb Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: borzoi Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: tiogapass-bmc Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: spitz Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: virt-2.7 Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: nuri Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: mcimx7d-sabre Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: romulus-bmc Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: virt-3.0 Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: virt-5.0 Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: npcm750-evb Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: virt-2.10 Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: rainier-bmc Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: mps3-an547 Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: virt-2.8 Jun 25 04:38:45.419164 np0000003587 nova-compute[98952]: musca-b1 Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: realview-pbx-a9 Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: versatileab Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: kzm Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: fby35-bmc Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: musca-a Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: virt-3.1 Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: mcimx6ul-evk Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: virt-5.1 Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: smdkc210 Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: sx1 Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: virt-2.11 Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: imx25-pdk Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: stm32vldiscovery Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: virt-2.9 Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: orangepi-pc Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: quanta-q71l-bmc Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: z2 Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: virt-5.2 Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: xilinx-zynq-a9 Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: xlnx-zcu102 Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: tosa Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: mps2-an500 Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: virt-2.12 Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: mps2-an521 Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: sabrelite Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: mps2-an511 Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: canon-a1100 Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: realview-eb Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: quanta-gbs-bmc Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: emcraft-sf2 Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: realview-pb-a8 Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: sbsa-ref Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: yosemitev2-bmc Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: virt-7.0 Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: virt-4.0 Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: raspi1ap Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: palmetto-bmc Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: sx1-v1 Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: n810 Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: g220a-bmc Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: n800 Jun 25 04:38:45.419906 np0000003587 nova-compute[98952]: bletchley-bmc Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: virt-7.1 Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: tacoma-bmc Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: virt-4.1 Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: quanta-gsj Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: versatilepb Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: terrier Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: mainstone Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: realview-eb-mpcore Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: integratorcp Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: virt-7.2 Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: supermicrox11-bmc Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: virt-4.2 Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: witherspoon-bmc Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: qcom-firework-bmc Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: mps3-an524 Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: kudo-bmc Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: vexpress-a9 Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: midway Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: musicpal Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: lm3s811evb Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: lm3s6965evb Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: supermicro-x11spi-bmc Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: microbit Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: fby35 Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: mps2-an505 Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: mps2-an385 Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: virt-6.0 Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: virt-8.0 Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: raspi3ap Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: cubieboard Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: ast1030-evb Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: verdex Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: bpim2u Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: netduino2 Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: xlnx-versal-virt Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: mps2-an386 Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: olimex-stm32-h405 Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: virt-6.1 Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: virt-8.1 Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: raspi3b Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: raspi2b Jun 25 04:38:45.420518 np0000003587 nova-compute[98952]: vexpress-a15 Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: fuji-bmc Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: virt-6.2 Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: sonorapass-bmc Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: cheetah Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: virt-2.6 Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: ast2500-evb Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: highbank Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: akita Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: connex Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: netduinoplus2 Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: collie Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: raspi0 Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: fp5280g2-bmc Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: hvm Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: 32 Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-cris Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: axis-dev88 Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: hvm Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: 32 Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-i386 Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: pc-i440fx-noble-v2 Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: ubuntu Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: pc-q35-mantic Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: pc-i440fx-impish-hpb Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: pc-q35-5.2 Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: pc-q35-lunar-hpb Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: pc-i440fx-mantic Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: pc-i440fx-2.12 Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: pc-i440fx-2.0 Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: pc-i440fx-xenial Jun 25 04:38:45.423172 np0000003587 nova-compute[98952]: pc-q35-kinetic Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-i440fx-6.2 Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-q35-4.2 Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-i440fx-mantic-maxcpus Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-i440fx-2.5 Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-i440fx-4.2 Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-i440fx-focal Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-i440fx-hirsute Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-q35-xenial Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-i440fx-jammy-hpb Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-i440fx-5.2 Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-q35-2.7 Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-q35-eoan-hpb Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-i440fx-disco-hpb Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-q35-groovy Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-i440fx-zesty Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-q35-lunar Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-q35-mantic-hpb-maxcpus Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-i440fx-groovy Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-q35-7.1 Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-q35-artful Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-i440fx-trusty Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-i440fx-2.2 Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-i440fx-eoan-hpb Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-q35-focal-hpb Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-q35-8.1 Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-q35-jammy-maxcpus Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-q35-bionic-hpb Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-q35-mantic-hpb Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-i440fx-artful Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-i440fx-8.1 Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-i440fx-2.7 Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-q35-6.1 Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-i440fx-kinetic Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-i440fx-jammy-maxcpus Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-i440fx-yakkety Jun 25 04:38:45.424118 np0000003587 nova-compute[98952]: pc-q35-2.4 Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-q35-cosmic-hpb Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-i440fx-7.1 Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-q35-2.10 Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: x-remote Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-q35-5.1 Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-q35-2.9 Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-i440fx-2.11 Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-i440fx-jammy-hpb-maxcpus Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-q35-3.1 Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-i440fx-6.1 Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-q35-4.1 Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-q35-jammy Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-i440fx-2.4 Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-i440fx-4.1 Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-q35-eoan Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-q35-jammy-hpb Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-i440fx-5.1 Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-i440fx-2.9 Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-i440fx-bionic-hpb Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-i440fx-lunar Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: isapc Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-i440fx-mantic-hpb Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-q35-cosmic Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-q35-2.6 Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-q35-mantic-maxcpus Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-i440fx-3.1 Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-q35-bionic Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-q35-disco-hpb Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-i440fx-cosmic Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-q35-2.12 Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-i440fx-bionic Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-q35-kinetic-hpb Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-q35-groovy-hpb Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-q35-7.0 Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-q35-noble-v2 Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: ubuntu-q35 Jun 25 04:38:45.424728 np0000003587 nova-compute[98952]: pc-i440fx-lunar-hpb Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-q35-disco Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-i440fx-cosmic-hpb Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-q35-noble Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: q35 Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-i440fx-2.1 Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-q35-8.0 Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-q35-impish Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-i440fx-wily Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-i440fx-8.0 Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-i440fx-2.6 Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-q35-6.0 Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-i440fx-impish Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-i440fx-jammy Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-q35-impish-hpb Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-q35-hirsute Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-q35-4.0.1 Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-q35-hirsute-hpb Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-i440fx-7.0 Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-q35-5.0 Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-q35-2.8 Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-i440fx-2.10 Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-q35-3.0 Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-i440fx-6.0 Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-q35-zesty Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-q35-7.2 Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-q35-4.0 Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-q35-focal Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: microvm Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-i440fx-2.3 Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-q35-jammy-hpb-maxcpus Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-q35-8.2 Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: q35 Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-i440fx-kinetic-hpb Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-i440fx-focal-hpb Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-i440fx-4.0 Jun 25 04:38:45.425381 np0000003587 nova-compute[98952]: pc-i440fx-noble Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: pc Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: pc-i440fx-disco Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: pc-i440fx-groovy-hpb Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: pc-i440fx-8.2 Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: pc Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: pc-i440fx-hirsute-hpb Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: pc-i440fx-5.0 Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: pc-q35-6.2 Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: pc-i440fx-2.8 Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: pc-i440fx-eoan Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: pc-q35-2.5 Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: pc-i440fx-3.0 Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: pc-q35-yakkety Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: pc-i440fx-mantic-hpb-maxcpus Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: pc-i440fx-7.2 Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: pc-q35-2.11 Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: hvm Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: 32 Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-m68k Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: mcf5208evb Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: virt-7.0 Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: an5206 Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: virt-6.0 Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: q800 Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: virt-8.1 Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: virt-7.2 Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: virt-6.2 Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: virt-8.0 Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: next-cube Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: virt-7.1 Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: virt-6.1 Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: virt-8.2 Jun 25 04:38:45.427912 np0000003587 nova-compute[98952]: virt Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: hvm Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: 32 Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-microblaze Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: petalogix-s3adsp1800 Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: petalogix-ml605 Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: xlnx-zynqmp-pmu Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: hvm Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: 32 Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-microblazeel Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: petalogix-s3adsp1800 Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: petalogix-ml605 Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: xlnx-zynqmp-pmu Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: hvm Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: 32 Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-mips Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: malta Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: mipssim Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: hvm Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: 32 Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-mipsel Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: malta Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: mipssim Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.429457 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: hvm Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: 64 Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-mips64 Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: malta Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: mipssim Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: pica61 Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: magnum Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: hvm Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: 64 Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-mips64el Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: malta Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: loongson3-virt Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: mipssim Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: pica61 Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: magnum Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: boston Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: fuloong2e Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: hvm Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: 32 Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-ppc Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: g3beige Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: amigaone Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: virtex-ml507 Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: mac99 Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: ppce500 Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: sam460ex Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: pegasos2 Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: bamboo Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: 40p Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: ref405ep Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: mpc8544ds Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.432170 np0000003587 nova-compute[98952]: Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: hvm Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: 64 Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-ppc64 Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pseries-noble Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pseries Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: amigaone Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: powernv9 Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: powernv Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pseries-4.1 Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: mpc8544ds Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pseries-6.1 Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pseries-2.5 Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: powernv10 Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pseries-xenial Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pseries-4.2 Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pseries-6.2 Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pseries-yakkety Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pseries-2.6 Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: ppce500 Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pseries-bionic-sxxm Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pseries-2.7 Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pseries-3.0 Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pseries-8.0 Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pseries-5.0 Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: 40p Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pseries-lunar Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pseries-2.8 Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pegasos2 Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pseries-hirsute Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pseries-3.1 Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pseries-8.1 Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pseries-5.1 Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pseries-eoan Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pseries-2.9 Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pseries-zesty Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: bamboo Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pseries-groovy Jun 25 04:38:45.434344 np0000003587 nova-compute[98952]: pseries-focal Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: g3beige Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: pseries-8.2 Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: pseries-5.2 Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: pseries-disco Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: pseries-2.12-sxxm Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: pseries-mantic Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: pseries-kinetic Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: pseries-2.10 Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: pseries-7.0 Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: virtex-ml507 Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: pseries-2.11 Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: pseries-2.1 Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: pseries-7.1 Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: pseries-cosmic Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: pseries-bionic Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: pseries-2.12 Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: pseries-2.2 Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: pseries-7.2 Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: mac99 Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: pseries-impish Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: pseries-jammy Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: pseries-artful Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: sam460ex Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: ref405ep Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: pseries-2.3 Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: powernv8 Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: pseries-4.0 Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: pseries-6.0 Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: pseries-2.4 Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: hvm Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: 64 Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-ppc64le Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: pseries-noble Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: pseries Jun 25 04:38:45.435120 np0000003587 nova-compute[98952]: amigaone Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: powernv9 Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: powernv Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-4.1 Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: mpc8544ds Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-6.1 Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-2.5 Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: powernv10 Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-xenial Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-4.2 Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-6.2 Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-yakkety Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-2.6 Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: ppce500 Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-bionic-sxxm Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-2.7 Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-3.0 Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-8.0 Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-5.0 Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: 40p Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-lunar Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-2.8 Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pegasos2 Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-hirsute Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-3.1 Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-8.1 Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-5.1 Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-eoan Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-2.9 Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-zesty Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: bamboo Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-groovy Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-focal Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: g3beige Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-8.2 Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-5.2 Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-disco Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-2.12-sxxm Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-mantic Jun 25 04:38:45.436479 np0000003587 nova-compute[98952]: pseries-kinetic Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: pseries-2.10 Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: pseries-7.0 Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: virtex-ml507 Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: pseries-2.11 Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: pseries-2.1 Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: pseries-7.1 Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: pseries-cosmic Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: pseries-bionic Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: pseries-2.12 Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: pseries-2.2 Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: pseries-7.2 Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: mac99 Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: pseries-impish Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: pseries-jammy Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: pseries-artful Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: sam460ex Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: ref405ep Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: pseries-2.3 Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: powernv8 Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: pseries-4.0 Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: pseries-6.0 Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: pseries-2.4 Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: hvm Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: 32 Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-riscv32 Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: virt Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: spike Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: opentitan Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: sifive_u Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: sifive_e Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: hvm Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: 64 Jun 25 04:38:45.438660 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-riscv64 Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: virt Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: spike Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: microchip-icicle-kit Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: sifive_u Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: shakti_c Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: sifive_e Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: hvm Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: 64 Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-s390x Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: s390-ccw-virtio-noble Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: s390-ccw-virtio Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: s390-ccw-virtio-8.0 Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: s390-ccw-virtio-disco Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: s390-ccw-virtio-6.0 Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: s390-ccw-virtio-2.11 Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: s390-ccw-virtio-7.0 Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: s390-ccw-virtio-mantic Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: s390-ccw-virtio-xenial Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: s390-ccw-virtio-5.0 Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: s390-ccw-virtio-focal Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: s390-ccw-virtio-2.8 Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: s390-ccw-virtio-4.0 Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: s390-ccw-virtio-zesty Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: s390-ccw-virtio-8.2 Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: s390-ccw-virtio-6.2 Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: s390-ccw-virtio-3.0 Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: s390-ccw-virtio-groovy Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: s390-ccw-virtio-2.5 Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: s390-ccw-virtio-7.2 Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: s390-ccw-virtio-5.2 Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: s390-ccw-virtio-artful Jun 25 04:38:45.439633 np0000003587 nova-compute[98952]: s390-ccw-virtio-hirsute Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: s390-ccw-virtio-4.2 Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: s390-ccw-virtio-2.10 Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: s390-ccw-virtio-2.7 Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: s390-ccw-virtio-lunar Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: s390-ccw-virtio-eoan Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: s390-ccw-virtio-kinetic Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: s390-ccw-virtio-8.1 Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: s390-ccw-virtio-yakkety Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: s390-ccw-virtio-6.1 Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: s390-ccw-virtio-cosmic Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: s390-ccw-virtio-bionic Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: s390-ccw-virtio-2.12 Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: s390-ccw-virtio-7.1 Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: s390-ccw-virtio-2.4 Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: s390-ccw-virtio-5.1 Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: s390-ccw-virtio-2.9 Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: s390-ccw-virtio-impish Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: s390-ccw-virtio-4.1 Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: s390-ccw-virtio-jammy Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: s390-ccw-virtio-3.1 Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: s390-ccw-virtio-2.6 Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: hvm Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: 32 Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-sh4 Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: shix Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: r2d Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: hvm Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: 64 Jun 25 04:38:45.440678 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-sh4eb Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: shix Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: r2d Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: hvm Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: 32 Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-sparc Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: SS-5 Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: SS-20 Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: LX Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: SPARCClassic Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: leon3_generic Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: SPARCbook Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: SS-4 Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: SS-600MP Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: SS-10 Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Voyager Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: hvm Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: 64 Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-sparc64 Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: sun4u Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: niagara Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: sun4v Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: hvm Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: 64 Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-x86_64 Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: pc-i440fx-noble-v2 Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: ubuntu Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: pc-q35-mantic Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: pc-i440fx-impish-hpb Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: pc-q35-5.2 Jun 25 04:38:45.442482 np0000003587 nova-compute[98952]: pc-q35-lunar-hpb Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-i440fx-mantic Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-i440fx-2.12 Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-i440fx-2.0 Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-i440fx-xenial Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-q35-kinetic Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-i440fx-6.2 Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-q35-4.2 Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-i440fx-mantic-maxcpus Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-i440fx-2.5 Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-i440fx-4.2 Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-i440fx-focal Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-i440fx-hirsute Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-q35-xenial Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-i440fx-jammy-hpb Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-i440fx-5.2 Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-q35-2.7 Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-q35-eoan-hpb Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-i440fx-zesty Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-q35-groovy Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-i440fx-disco-hpb Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-q35-lunar Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-q35-mantic-hpb-maxcpus Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-i440fx-groovy Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-q35-7.1 Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-q35-artful Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-i440fx-trusty Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-i440fx-2.2 Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-q35-focal-hpb Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-q35-8.1 Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-i440fx-eoan-hpb Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-q35-jammy-maxcpus Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-q35-bionic-hpb Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-q35-mantic-hpb Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-i440fx-artful Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-i440fx-8.1 Jun 25 04:38:45.445011 np0000003587 nova-compute[98952]: pc-i440fx-2.7 Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-q35-6.1 Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-i440fx-kinetic Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-i440fx-jammy-maxcpus Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-i440fx-yakkety Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-q35-2.4 Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-q35-cosmic-hpb Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-i440fx-7.1 Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-q35-2.10 Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: x-remote Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-q35-5.1 Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-q35-2.9 Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-i440fx-2.11 Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-i440fx-jammy-hpb-maxcpus Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-q35-3.1 Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-i440fx-6.1 Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-q35-4.1 Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-q35-jammy Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-i440fx-2.4 Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-i440fx-4.1 Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-q35-eoan Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-q35-jammy-hpb Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-i440fx-5.1 Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-i440fx-2.9 Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-i440fx-bionic-hpb Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-i440fx-lunar Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: isapc Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-i440fx-mantic-hpb Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-q35-cosmic Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-q35-2.6 Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-q35-mantic-maxcpus Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-i440fx-3.1 Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-q35-bionic Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-q35-disco-hpb Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-i440fx-cosmic Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-q35-2.12 Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-i440fx-bionic Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-q35-kinetic-hpb Jun 25 04:38:45.446138 np0000003587 nova-compute[98952]: pc-q35-groovy-hpb Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-q35-7.0 Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-q35-noble-v2 Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: ubuntu-q35 Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-i440fx-lunar-hpb Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-q35-disco Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-i440fx-cosmic-hpb Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-i440fx-2.1 Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-q35-noble Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: q35 Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-q35-8.0 Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-i440fx-wily Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-q35-impish Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-i440fx-8.0 Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-i440fx-2.6 Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-q35-6.0 Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-i440fx-impish Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-i440fx-jammy Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-q35-impish-hpb Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-q35-hirsute Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-q35-4.0.1 Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-q35-hirsute-hpb Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-i440fx-7.0 Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-q35-5.0 Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-q35-2.8 Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-i440fx-2.10 Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-q35-3.0 Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-q35-zesty Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-q35-7.2 Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-q35-4.0 Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-i440fx-6.0 Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-q35-focal Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: microvm Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-i440fx-2.3 Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-q35-jammy-hpb-maxcpus Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-i440fx-disco Jun 25 04:38:45.447087 np0000003587 nova-compute[98952]: pc-i440fx-kinetic-hpb Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: pc-i440fx-4.0 Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: pc-i440fx-focal-hpb Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: pc-i440fx-noble Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: pc Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: pc-q35-8.2 Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: q35 Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: pc-i440fx-groovy-hpb Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: pc-i440fx-hirsute-hpb Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: pc-i440fx-8.2 Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: pc Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: pc-i440fx-5.0 Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: pc-i440fx-2.8 Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: pc-q35-6.2 Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: pc-i440fx-eoan Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: pc-q35-2.5 Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: pc-i440fx-3.0 Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: pc-q35-yakkety Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: pc-i440fx-mantic-hpb-maxcpus Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: pc-i440fx-7.2 Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: pc-q35-2.11 Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: hvm Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: 32 Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-xtensa Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: sim Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: kc705 Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: ml605 Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: ml605-nommu Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: virt Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: lx60-nommu Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: lx200 Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: lx200-nommu Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: lx60 Jun 25 04:38:45.447673 np0000003587 nova-compute[98952]: kc705-nommu Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: hvm Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: 32 Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-xtensaeb Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: sim Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: kc705 Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: ml605 Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: ml605-nommu Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: virt Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: lx60-nommu Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: lx200 Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: lx200-nommu Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: lx60 Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: kc705-nommu Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=98952) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=alpha and machine_type=None: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-alpha Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: clipper Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: alpha Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.448716 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: Jun 25 04:38:45.451665 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=98952) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=None: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-arm Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: virt-8.2 Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: armv6l Jun 25 04:38:45.452934 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: on Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: off Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: pxa270-c0 Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: cortex-a15 Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: pxa270-b0 Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: cortex-m4 Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: pxa270-a0 Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: arm1176 Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: pxa270-b1 Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: cortex-a7 Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: pxa270-a1 Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: cortex-a8 Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: cortex-r5 Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: ti925t Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: cortex-r5f Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: arm1026 Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: cortex-a9 Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: cortex-m7 Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: pxa270 Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: pxa260 Jun 25 04:38:45.455156 np0000003587 nova-compute[98952]: pxa250 Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: pxa270-c5 Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: pxa261 Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: pxa262 Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: sa1110 Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: cortex-r52 Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: sa1100 Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: max Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: cortex-m0 Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: cortex-m33 Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: arm946 Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: pxa255 Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: arm11mpcore Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: cortex-m55 Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: arm926 Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: arm1136 Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: arm1136-r2 Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: cortex-m3 Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.455889 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: tpm-tis Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: passthrough Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: emulator Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: external Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: 1.2 Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: 2.0 Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.457675 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: 2 Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: 3 Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=virt: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-arm Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: virt-8.2 Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: armv6l Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: on Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: off Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: pxa270-c0 Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: cortex-a15 Jun 25 04:38:45.459335 np0000003587 nova-compute[98952]: pxa270-b0 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: cortex-m4 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: pxa270-a0 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: arm1176 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: pxa270-b1 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: cortex-a7 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: pxa270-a1 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: cortex-a8 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: cortex-r5 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: ti925t Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: cortex-r5f Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: arm1026 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: cortex-a9 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: cortex-m7 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: pxa270 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: pxa260 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: pxa250 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: pxa270-c5 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: pxa261 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: pxa262 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: sa1110 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: cortex-r52 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: sa1100 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: max Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: cortex-m0 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: cortex-m33 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: arm946 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: pxa255 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: arm11mpcore Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: cortex-m55 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: arm926 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: arm1136 Jun 25 04:38:45.461169 np0000003587 nova-compute[98952]: arm1136-r2 Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: cortex-m3 Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: Jun 25 04:38:45.462122 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: tpm-tis Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: passthrough Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: emulator Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: external Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: 1.2 Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: 2.0 Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: 2 Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: 3 Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.464113 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=98952) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=armv7l and machine_type=virt: Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-arm Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: virt-8.2 Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: armv7l Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: efi Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: on Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: off Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: pxa270-c0 Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: cortex-a15 Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: pxa270-b0 Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: cortex-m4 Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: pxa270-a0 Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: arm1176 Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: pxa270-b1 Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: cortex-a7 Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: pxa270-a1 Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: cortex-a8 Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: cortex-r5 Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: ti925t Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: cortex-r5f Jun 25 04:38:45.466318 np0000003587 nova-compute[98952]: arm1026 Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: cortex-a9 Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: cortex-m7 Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: pxa270 Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: pxa260 Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: pxa250 Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: pxa270-c5 Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: pxa261 Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: pxa262 Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: sa1110 Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: cortex-r52 Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: sa1100 Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: max Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: cortex-m0 Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: cortex-m33 Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: arm946 Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: pxa255 Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: arm11mpcore Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: cortex-m55 Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: arm926 Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: arm1136 Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: arm1136-r2 Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: cortex-m3 Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: Jun 25 04:38:45.467949 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: tpm-tis Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: passthrough Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: emulator Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: external Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: 1.2 Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: 2.0 Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: Jun 25 04:38:45.469291 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: 2 Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: 3 Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=98952) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=aarch64 and machine_type=virt: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-aarch64 Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: virt-8.2 Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: aarch64 Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: efi Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.ms.fd Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.secboot.fd Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.no-secboot.fd Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.471628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: on Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: off Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: neoverse-n2 Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: pxa270-c0 Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: cortex-a15 Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: pxa270-b0 Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: cortex-a57 Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: cortex-m4 Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: pxa270-a0 Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: arm1176 Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: pxa270-b1 Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: cortex-a7 Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: pxa270-a1 Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: cortex-a76 Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: a64fx Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: cortex-a8 Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: neoverse-v1 Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: cortex-r5 Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: ti925t Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: cortex-r5f Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: arm1026 Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: cortex-a9 Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: cortex-m7 Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: pxa270 Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: pxa260 Jun 25 04:38:45.474124 np0000003587 nova-compute[98952]: pxa250 Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: pxa270-c5 Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: pxa261 Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: pxa262 Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: cortex-a710 Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: sa1110 Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: cortex-r52 Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: sa1100 Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: max Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: cortex-a53 Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: cortex-m0 Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: cortex-m33 Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: cortex-a72 Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: arm946 Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: pxa255 Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: cortex-a55 Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: arm11mpcore Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: cortex-m55 Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: neoverse-n1 Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: arm926 Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: arm1136 Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: cortex-a35 Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: arm1136-r2 Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: cortex-m3 Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.475312 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: tpm-tis Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: passthrough Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: emulator Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: external Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: 1.2 Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: 2.0 Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.476729 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: 2 Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: 3 Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Getting domain capabilities for cris via machine types: {None} {{(pid=98952) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=cris and machine_type=None: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-cris Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: axis-dev88 Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: cris Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.479411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.481537 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=98952) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-i386 Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: pc-i440fx-noble-v2 Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: i686 Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.483518 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: on Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: off Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: EPYC Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: AMD Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: qemu64 Jun 25 04:38:45.486226 np0000003587 nova-compute[98952]: qemu32 Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: phenom Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: pentium3 Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: pentium2 Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: pentium Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: n270 Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: kvm64 Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: kvm32 Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: coreduo Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: core2duo Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: athlon Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: Westmere-IBRS Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: Westmere Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: Snowridge Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: Skylake-Server-noTSX-IBRS Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: Skylake-Server-IBRS Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: Skylake-Server Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: Skylake-Client-noTSX-IBRS Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: Skylake-Client-IBRS Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: Skylake-Client Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: SapphireRapids Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: SandyBridge-IBRS Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: SandyBridge Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: Penryn Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: Opteron_G5 Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: Opteron_G4 Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: Opteron_G3 Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: Opteron_G2 Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: Opteron_G1 Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: Nehalem-IBRS Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: IvyBridge-IBRS Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: IvyBridge Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: Icelake-Server-noTSX Jun 25 04:38:45.487385 np0000003587 nova-compute[98952]: Icelake-Server Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Haswell-noTSX-IBRS Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Haswell-noTSX Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Haswell-IBRS Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Haswell Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: EPYC-Rome Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: EPYC-Milan Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: EPYC-IBPB Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: EPYC-Genoa Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: EPYC Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Dhyana Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Cooperlake Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Conroe Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Cascadelake-Server-noTSX Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Cascadelake-Server Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Broadwell-noTSX-IBRS Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Broadwell-noTSX Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Broadwell-IBRS Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Broadwell Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: 486 Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: ide Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.488492 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: tpm-tis Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: tpm-crb Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: passthrough Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: emulator Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: external Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: 1.2 Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: 2.0 Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.489904 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: relaxed Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: vapic Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: spinlocks Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: vpindex Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: runtime Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: synic Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: stimer Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: reset Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: vendor_id Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: frequencies Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: reenlightenment Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: tlbflush Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: ipi Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: avic Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-i386 Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: pc-q35-noble-v2 Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: i686 Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.491052 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: on Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: off Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: EPYC Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: AMD Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: Jun 25 04:38:45.492141 np0000003587 nova-compute[98952]: qemu64 Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: qemu32 Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: phenom Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: pentium3 Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: pentium2 Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: pentium Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: n270 Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: kvm64 Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: kvm32 Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: coreduo Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: core2duo Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: athlon Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: Westmere-IBRS Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: Westmere Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: Snowridge Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: Skylake-Server-noTSX-IBRS Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: Skylake-Server-IBRS Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: Skylake-Server Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: Skylake-Client-noTSX-IBRS Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: Skylake-Client-IBRS Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: Skylake-Client Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: SapphireRapids Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: SandyBridge-IBRS Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: SandyBridge Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: Penryn Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: Opteron_G5 Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: Opteron_G4 Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: Opteron_G3 Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: Opteron_G2 Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: Opteron_G1 Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: Nehalem-IBRS Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: IvyBridge-IBRS Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: IvyBridge Jun 25 04:38:45.493240 np0000003587 nova-compute[98952]: Icelake-Server-noTSX Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Icelake-Server Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Haswell-noTSX-IBRS Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Haswell-noTSX Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Haswell-IBRS Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Haswell Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: EPYC-Rome Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: EPYC-Milan Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: EPYC-IBPB Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: EPYC-Genoa Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: EPYC Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Dhyana Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Cooperlake Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Conroe Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Cascadelake-Server-noTSX Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Cascadelake-Server Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Broadwell-noTSX-IBRS Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Broadwell-noTSX Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Broadwell-IBRS Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Broadwell Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: 486 Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: Jun 25 04:38:45.493736 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: tpm-tis Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: tpm-crb Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: passthrough Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: emulator Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: external Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: 1.2 Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: 2.0 Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.496239 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: relaxed Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: vapic Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: spinlocks Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: vpindex Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: runtime Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: synic Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: stimer Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: reset Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: vendor_id Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: frequencies Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: reenlightenment Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: tlbflush Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: ipi Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: avic Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-i386 Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: pc-q35-noble Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: i686 Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.498225 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: on Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: off Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: EPYC Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: AMD Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.501090 np0000003587 nova-compute[98952]: Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: qemu64 Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: qemu32 Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: phenom Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: pentium3 Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: pentium2 Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: pentium Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: n270 Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: kvm64 Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: kvm32 Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: coreduo Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: core2duo Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: athlon Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: Westmere-IBRS Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: Westmere Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: Snowridge Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: Skylake-Server-noTSX-IBRS Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: Skylake-Server-IBRS Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: Skylake-Server Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: Skylake-Client-noTSX-IBRS Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: Skylake-Client-IBRS Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: Skylake-Client Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: SapphireRapids Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: SandyBridge-IBRS Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: SandyBridge Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: Penryn Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: Opteron_G5 Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: Opteron_G4 Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: Opteron_G3 Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: Opteron_G2 Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: Opteron_G1 Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: Nehalem-IBRS Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: IvyBridge-IBRS Jun 25 04:38:45.503334 np0000003587 nova-compute[98952]: IvyBridge Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Icelake-Server-noTSX Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Icelake-Server Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Haswell-noTSX-IBRS Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Haswell-noTSX Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Haswell-IBRS Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Haswell Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: EPYC-Rome Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: EPYC-Milan Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: EPYC-IBPB Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: EPYC-Genoa Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: EPYC Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Dhyana Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Cooperlake Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Conroe Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Cascadelake-Server-noTSX Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Cascadelake-Server Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Broadwell-noTSX-IBRS Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Broadwell-noTSX Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Broadwell-IBRS Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Broadwell Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: 486 Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Jun 25 04:38:45.504352 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: tpm-tis Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: tpm-crb Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: passthrough Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: emulator Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: external Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: 1.2 Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: 2.0 Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.507199 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: relaxed Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: vapic Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: spinlocks Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: vpindex Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: runtime Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: synic Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: stimer Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: reset Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: vendor_id Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: frequencies Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: reenlightenment Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: tlbflush Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: ipi Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: avic Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-i386 Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: pc-i440fx-noble Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: i686 Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.513270 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: on Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: off Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: EPYC Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: AMD Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.515628 np0000003587 nova-compute[98952]: Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: qemu64 Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: qemu32 Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: phenom Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: pentium3 Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: pentium2 Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: pentium Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: n270 Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: kvm64 Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: kvm32 Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: coreduo Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: core2duo Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: athlon Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: Westmere-IBRS Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: Westmere Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: Snowridge Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: Skylake-Server-noTSX-IBRS Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: Skylake-Server-IBRS Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: Skylake-Server Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: Skylake-Client-noTSX-IBRS Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: Skylake-Client-IBRS Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: Skylake-Client Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: SapphireRapids Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: SandyBridge-IBRS Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: SandyBridge Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: Penryn Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: Opteron_G5 Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: Opteron_G4 Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: Opteron_G3 Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: Opteron_G2 Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: Opteron_G1 Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: Nehalem-IBRS Jun 25 04:38:45.516608 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: IvyBridge-IBRS Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: IvyBridge Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Icelake-Server-noTSX Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Icelake-Server Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Haswell-noTSX-IBRS Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Haswell-noTSX Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Haswell-IBRS Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Haswell Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: EPYC-Rome Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: EPYC-Milan Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: EPYC-IBPB Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: EPYC-Genoa Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: EPYC Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Dhyana Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Cooperlake Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Conroe Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Cascadelake-Server-noTSX Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Cascadelake-Server Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Broadwell-noTSX-IBRS Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Broadwell-noTSX Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Broadwell-IBRS Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Broadwell Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: 486 Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: ide Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: Jun 25 04:38:45.517246 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: tpm-tis Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: tpm-crb Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: passthrough Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: emulator Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: external Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: 1.2 Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: 2.0 Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.518040 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: relaxed Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: vapic Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: spinlocks Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: vpindex Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: runtime Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: synic Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: stimer Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: reset Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: vendor_id Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: frequencies Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: reenlightenment Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: tlbflush Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: ipi Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: avic Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=98952) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=None: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-m68k Jun 25 04:38:45.519281 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: mcf5208evb Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: m68k Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.520262 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=virt: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-m68k Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: virt-8.2 Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: m68k Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.521519 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: Jun 25 04:38:45.522659 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=98952) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=microblaze and machine_type=None: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-microblaze Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: petalogix-s3adsp1800 Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: microblaze Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.524011 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.524980 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=98952) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=microblazeel and machine_type=None: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-microblazeel Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: petalogix-s3adsp1800 Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: microblazeel Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: Jun 25 04:38:45.526297 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.527308 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Getting domain capabilities for mips via machine types: {None} {{(pid=98952) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=mips and machine_type=None: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-mips Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: malta Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: mips Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.528663 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: ide Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.529772 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=98952) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=mipsel and machine_type=None: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-mipsel Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: malta Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: mipsel Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.531079 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: ide Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.532152 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: Jun 25 04:38:45.533342 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=98952) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=mips64 and machine_type=None: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-mips64 Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: malta Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: mips64 Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: ide Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.534411 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: Jun 25 04:38:45.535490 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=98952) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=mips64el and machine_type=None: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-mips64el Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: malta Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: mips64el Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: Jun 25 04:38:45.536774 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: ide Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.537796 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=98952) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=ppc and machine_type=None: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-ppc Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: g3beige Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: ppc Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.539109 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: ide Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.540388 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Getting domain capabilities for ppc64 via machine types: {None, 'pseries', 'powernv'} {{(pid=98952) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=None: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-ppc64 Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: pseries-noble Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: ppc64 Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.541740 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: POWER10 Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: POWER9 Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: POWER8 Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: POWER7 Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.542849 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: tpm-spapr Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: spapr-tpm-proxy Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: passthrough Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: emulator Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: external Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: 1.2 Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: 2.0 Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.544171 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=pseries: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-ppc64 Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: pseries-noble Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: ppc64 Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: POWER10 Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: POWER9 Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: POWER8 Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: POWER7 Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.545855 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: tpm-spapr Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: spapr-tpm-proxy Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: passthrough Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: emulator Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: external Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: 1.2 Jun 25 04:38:45.547133 np0000003587 nova-compute[98952]: 2.0 Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=powernv: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-ppc64 Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: powernv9 Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: ppc64 Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.548738 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: POWER10 Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: POWER9 Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: POWER8 Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: POWER7 Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.550183 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: tpm-spapr Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: spapr-tpm-proxy Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: passthrough Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: emulator Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: external Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: 1.2 Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: 2.0 Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.551669 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=98952) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=pseries: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-ppc64le Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: pseries-noble Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: ppc64le Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: POWER10 Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: POWER9 Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: POWER8 Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: POWER7 Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: Jun 25 04:38:45.553052 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: tpm-spapr Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: spapr-tpm-proxy Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: passthrough Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: emulator Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: external Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: 1.2 Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: 2.0 Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.554416 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=powernv: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-ppc64le Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: powernv9 Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: ppc64le Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: POWER10 Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: POWER9 Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: POWER8 Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: POWER7 Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.555856 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: Jun 25 04:38:45.557185 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: tpm-spapr Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: spapr-tpm-proxy Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: passthrough Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: emulator Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: external Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: 1.2 Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: 2.0 Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=98952) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=riscv32 and machine_type=None: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-riscv32 Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: virt Jun 25 04:38:45.558758 np0000003587 nova-compute[98952]: riscv32 Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: on Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: off Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.560066 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: tpm-tis Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: passthrough Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: emulator Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: external Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: 1.2 Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: 2.0 Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.561586 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=98952) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=riscv64 and machine_type=None: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-riscv64 Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: virt Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: riscv64 Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: on Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: off Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: rv64 Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: sifive-e51 Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: any Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: x-rv128 Jun 25 04:38:45.563248 np0000003587 nova-compute[98952]: shakti-c Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: max Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: thead-c906 Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: sifive-u54 Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: veyron-v1 Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.564712 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: tpm-tis Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: passthrough Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: emulator Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: external Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: 1.2 Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: 2.0 Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: Jun 25 04:38:45.566145 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=98952) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=s390x and machine_type=s390-ccw-virtio: Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-s390x Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: s390-ccw-virtio-noble Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: s390x Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: on Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: off Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: z13 Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: z990.3 Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: z13-base Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: z990.2 Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: z196.2-base Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: z14 Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: z14.2-base Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: z990.4 Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: z196 Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: z10BC.2-base Jun 25 04:38:45.567318 np0000003587 nova-compute[98952]: z114-base Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: gen16b Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z890.3-base Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: gen16a Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z990.5 Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z196.2 Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: zEC12 Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: zEC12.2 Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z9EC.2 Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z9BC Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z9EC.3-base Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z800-base Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z14ZR1-base Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z890 Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z990.4-base Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z9EC.3 Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z13.2 Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z10BC.2 Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: gen15a-base Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z14.2 Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: zBC12-base Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: gen16a-base Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z900.3 Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z196-base Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z990 Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z14-base Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z900.2 Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z800 Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z10EC Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z14ZR1 Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z900 Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z10EC.2 Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z10EC.2-base Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z900.2-base Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z900-base Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z10EC.3 Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: z990.5-base Jun 25 04:38:45.568164 np0000003587 nova-compute[98952]: max Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: gen15b Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: z9BC.2-base Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: gen15a Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: z990.2-base Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: z10EC-base Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: gen16b-base Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: z114 Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: z9EC-base Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: z13s Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: gen15b-base Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: zEC12-base Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: z890.3 Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: z10EC.3-base Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: z890.2-base Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: z890.2 Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: z10BC-base Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: zEC12.2-base Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: z890-base Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: z9BC-base Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: z10BC Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: z9EC Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: z9EC.2-base Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: z13.2-base Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: z900.3-base Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: z990.3-base Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: z13s-base Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: zBC12 Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: z990-base Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: z9BC.2 Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.568887 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.569743 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=98952) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=sh4 and machine_type=None: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-sh4 Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: shix Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: sh4 Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.571038 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: Jun 25 04:38:45.572045 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=98952) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=sh4eb and machine_type=None: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-sh4eb Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: shix Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: sh4eb Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.573303 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.574378 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=98952) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=sparc and machine_type=None: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-sparc Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.575664 np0000003587 nova-compute[98952]: SS-5 Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: sparc Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.576696 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=98952) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=sparc64 and machine_type=None: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-sparc64 Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: sun4u Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: sparc64 Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.578239 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: ide Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.579260 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: Jun 25 04:38:45.580494 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=98952) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-x86_64 Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: pc-i440fx-noble-v2 Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: x86_64 Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: efi Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: /usr/share/OVMF/OVMF_CODE_4M.fd Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: on Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: off Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: EPYC Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: AMD Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.581611 np0000003587 nova-compute[98952]: Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: qemu64 Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: qemu32 Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: phenom Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: pentium3 Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: pentium2 Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: pentium Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: n270 Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: kvm64 Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: kvm32 Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: coreduo Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: core2duo Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: athlon Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Westmere-IBRS Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Westmere Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Snowridge Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Skylake-Server-noTSX-IBRS Jun 25 04:38:45.582502 np0000003587 nova-compute[98952]: Skylake-Server-IBRS Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: Skylake-Server Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: Skylake-Client-noTSX-IBRS Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: Skylake-Client-IBRS Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: Skylake-Client Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: SapphireRapids Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: SandyBridge-IBRS Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: SandyBridge Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: Penryn Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: Opteron_G5 Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: Opteron_G4 Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: Opteron_G3 Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: Opteron_G2 Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: Opteron_G1 Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: Nehalem-IBRS Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: IvyBridge-IBRS Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: IvyBridge Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: Icelake-Server-noTSX Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: Icelake-Server Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: Haswell-noTSX-IBRS Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: Haswell-noTSX Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: Haswell-IBRS Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: Haswell Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: EPYC-Rome Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: EPYC-Milan Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: EPYC-IBPB Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: EPYC-Genoa Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: EPYC Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: Dhyana Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: Cooperlake Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: Conroe Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: Cascadelake-Server-noTSX Jun 25 04:38:45.583203 np0000003587 nova-compute[98952]: Cascadelake-Server Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Broadwell-noTSX-IBRS Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Broadwell-noTSX Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Broadwell-IBRS Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Broadwell Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: 486 Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: ide Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.583801 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: tpm-tis Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: tpm-crb Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: passthrough Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: emulator Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: external Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: 1.2 Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: 2.0 Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: relaxed Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: vapic Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: spinlocks Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: vpindex Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: runtime Jun 25 04:38:45.585059 np0000003587 nova-compute[98952]: synic Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: stimer Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: reset Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: vendor_id Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: frequencies Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: reenlightenment Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: tlbflush Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: ipi Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: avic Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-x86_64 Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: pc-q35-noble-v2 Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: x86_64 Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: efi Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: /usr/share/OVMF/OVMF_CODE_4M.ms.fd Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: /usr/share/OVMF/OVMF_CODE_4M.secboot.fd Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: /usr/share/ovmf/OVMF.amdsev.fd Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: /usr/share/OVMF/OVMF_CODE_4M.fd Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: on Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: off Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: EPYC Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: AMD Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.586364 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: qemu64 Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: qemu32 Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: phenom Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: pentium3 Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: pentium2 Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: pentium Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: n270 Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: kvm64 Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: kvm32 Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: coreduo Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: core2duo Jun 25 04:38:45.587418 np0000003587 nova-compute[98952]: athlon Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: Westmere-IBRS Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: Westmere Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: Snowridge Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: Skylake-Server-noTSX-IBRS Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: Skylake-Server-IBRS Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: Skylake-Server Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: Skylake-Client-noTSX-IBRS Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: Skylake-Client-IBRS Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: Skylake-Client Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: SapphireRapids Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: SandyBridge-IBRS Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: SandyBridge Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: Penryn Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: Opteron_G5 Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: Opteron_G4 Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: Opteron_G3 Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: Opteron_G2 Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: Opteron_G1 Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: Nehalem-IBRS Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: IvyBridge-IBRS Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: IvyBridge Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: Icelake-Server-noTSX Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: Icelake-Server Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: Haswell-noTSX-IBRS Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: Haswell-noTSX Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: Haswell-IBRS Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: Haswell Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: EPYC-Rome Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: EPYC-Milan Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: EPYC-IBPB Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: EPYC-Genoa Jun 25 04:38:45.588128 np0000003587 nova-compute[98952]: EPYC Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Dhyana Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Cooperlake Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Conroe Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Cascadelake-Server-noTSX Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Cascadelake-Server Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Broadwell-noTSX-IBRS Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Broadwell-noTSX Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Broadwell-IBRS Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Broadwell Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: 486 Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Jun 25 04:38:45.588706 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: tpm-tis Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: tpm-crb Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: passthrough Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: emulator Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: external Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: 1.2 Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: 2.0 Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.589806 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: relaxed Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: vapic Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: spinlocks Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: vpindex Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: runtime Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: synic Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: stimer Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: reset Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: vendor_id Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: frequencies Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: reenlightenment Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: tlbflush Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: ipi Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: avic Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-x86_64 Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: pc-q35-noble Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: x86_64 Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: efi Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: /usr/share/OVMF/OVMF_CODE_4M.ms.fd Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: /usr/share/OVMF/OVMF_CODE_4M.secboot.fd Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: /usr/share/ovmf/OVMF.amdsev.fd Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: /usr/share/OVMF/OVMF_CODE_4M.fd Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: on Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: off Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: EPYC Jun 25 04:38:45.591106 np0000003587 nova-compute[98952]: AMD Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: qemu64 Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: qemu32 Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: phenom Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: pentium3 Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: pentium2 Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: pentium Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: n270 Jun 25 04:38:45.592258 np0000003587 nova-compute[98952]: kvm64 Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: kvm32 Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: coreduo Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: core2duo Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: athlon Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: Westmere-IBRS Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: Westmere Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: Snowridge Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: Skylake-Server-noTSX-IBRS Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: Skylake-Server-IBRS Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: Skylake-Server Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: Skylake-Client-noTSX-IBRS Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: Skylake-Client-IBRS Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: Skylake-Client Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: SapphireRapids Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: SandyBridge-IBRS Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: SandyBridge Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: Penryn Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: Opteron_G5 Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: Opteron_G4 Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: Opteron_G3 Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: Opteron_G2 Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: Opteron_G1 Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: Nehalem-IBRS Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: IvyBridge-IBRS Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: IvyBridge Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: Icelake-Server-noTSX Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: Icelake-Server Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: Haswell-noTSX-IBRS Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: Haswell-noTSX Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: Haswell-IBRS Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: Haswell Jun 25 04:38:45.592961 np0000003587 nova-compute[98952]: EPYC-Rome Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: EPYC-Milan Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: EPYC-IBPB Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: EPYC-Genoa Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: EPYC Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Dhyana Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Cooperlake Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Conroe Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Cascadelake-Server-noTSX Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Cascadelake-Server Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Broadwell-noTSX-IBRS Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Broadwell-noTSX Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Broadwell-IBRS Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Broadwell Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: 486 Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Jun 25 04:38:45.593511 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: tpm-tis Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: tpm-crb Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: passthrough Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: emulator Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: external Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: 1.2 Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: 2.0 Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.594589 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: relaxed Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: vapic Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: spinlocks Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: vpindex Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: runtime Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: synic Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: stimer Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: reset Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: vendor_id Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: frequencies Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: reenlightenment Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: tlbflush Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: ipi Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: avic Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-x86_64 Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: pc-i440fx-noble Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: x86_64 Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: efi Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: /usr/share/OVMF/OVMF_CODE_4M.fd Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: on Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: off Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.595926 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: EPYC Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: AMD Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: qemu64 Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: qemu32 Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: phenom Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: pentium3 Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: pentium2 Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: pentium Jun 25 04:38:45.597028 np0000003587 nova-compute[98952]: n270 Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: kvm64 Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: kvm32 Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: coreduo Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: core2duo Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: athlon Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: Westmere-IBRS Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: Westmere Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: Snowridge Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: Skylake-Server-noTSX-IBRS Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: Skylake-Server-IBRS Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: Skylake-Server Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: Skylake-Client-noTSX-IBRS Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: Skylake-Client-IBRS Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: Skylake-Client Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: SapphireRapids Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: SandyBridge-IBRS Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: SandyBridge Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: Penryn Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: Opteron_G5 Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: Opteron_G4 Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: Opteron_G3 Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: Opteron_G2 Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: Opteron_G1 Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: Nehalem-IBRS Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: IvyBridge-IBRS Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: IvyBridge Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: Icelake-Server-noTSX Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: Icelake-Server Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: Haswell-noTSX-IBRS Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: Haswell-noTSX Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: Haswell-IBRS Jun 25 04:38:45.597740 np0000003587 nova-compute[98952]: Haswell Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: EPYC-Rome Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: EPYC-Milan Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: EPYC-IBPB Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: EPYC-Genoa Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: EPYC Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Dhyana Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Cooperlake Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Conroe Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Cascadelake-Server-noTSX Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Cascadelake-Server Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Broadwell-noTSX-IBRS Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Broadwell-noTSX Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Broadwell-IBRS Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Broadwell Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: 486 Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: ide Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.598295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: tpm-tis Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: tpm-crb Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: passthrough Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: emulator Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: external Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: 1.2 Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: 2.0 Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.599295 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: relaxed Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: vapic Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: spinlocks Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: vpindex Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: runtime Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: synic Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: stimer Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: reset Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: vendor_id Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: frequencies Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: reenlightenment Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: tlbflush Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: ipi Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: avic Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=98952) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=xtensa and machine_type=None: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-xtensa Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: sim Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: xtensa Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.600577 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.601547 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=98952) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt host hypervisor capabilities for arch=xtensaeb and machine_type=None: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-xtensaeb Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: sim Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: xtensaeb Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.602841 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: rom Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: pflash Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: yes Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: no Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: file Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: anonymous Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: memfd Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: disk Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: cdrom Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: floppy Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: lun Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: fdc Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: sata Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: sdl Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: vnc Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: spice Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: egl-headless Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: dbus Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: subsystem Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: default Jun 25 04:38:45.603895 np0000003587 nova-compute[98952]: mandatory Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: requisite Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: optional Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: pci Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: scsi Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: virtio-transitional Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: virtio-non-transitional Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: random Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: egd Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: path Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: handle Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: virtiofs Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: usb Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: pty Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: unix Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: spicevmc Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: virtio Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: qemu Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: builtin Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: {{(pid=98952) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 25 04:38:45.605493 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Checking secure boot support for host arch (x86_64) {{(pid=98952) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}} Jun 25 04:38:45.606651 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Checking secure boot support for host arch (x86_64) {{(pid=98952) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}} Jun 25 04:38:45.606651 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Checking secure boot support for host arch (x86_64) {{(pid=98952) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}} Jun 25 04:38:45.606651 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Secure Boot support detected Jun 25 04:38:46.037528 np0000003587 nova-compute[98952]: INFO nova.virt.node [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Generated node identity e72c7643-c1ab-4c4d-a044-2b10e1a98687 Jun 25 04:38:46.037708 np0000003587 nova-compute[98952]: INFO nova.virt.node [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Wrote node identity e72c7643-c1ab-4c4d-a044-2b10e1a98687 to /opt/stack/data/nova/compute_id Jun 25 04:38:46.540053 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Compute nodes ['e72c7643-c1ab-4c4d-a044-2b10e1a98687'] for host np0000003587 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning. Jun 25 04:38:47.543650 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host Jun 25 04:38:48.548486 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] No compute node record found for host np0000003587. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000003587 could not be found. Jun 25 04:38:48.549123 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:38:48.549123 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:38:48.549123 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:38:48.549123 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Auditing locally available compute resources for np0000003587 (node: np0000003587) {{(pid=98952) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 25 04:38:48.604650 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:38:48.605406 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:38:48.617823 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] CMD "env LANG=C uptime" returned: 0 in 0.012s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:38:48.618240 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Hypervisor/Node resource view: name=np0000003587 free_ram=55584MB free_disk=75.22675323486328GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98952) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 25 04:38:48.618421 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:38:48.618718 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:38:49.121546 np0000003587 nova-compute[98952]: WARNING nova.compute.resource_tracker [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] No compute node record for np0000003587:e72c7643-c1ab-4c4d-a044-2b10e1a98687: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host e72c7643-c1ab-4c4d-a044-2b10e1a98687 could not be found. Jun 25 04:38:49.625658 np0000003587 nova-compute[98952]: INFO nova.compute.resource_tracker [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Compute node record created for np0000003587:np0000003587 with uuid: e72c7643-c1ab-4c4d-a044-2b10e1a98687 Jun 25 04:38:51.132286 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Total usable vcpus: 16, total allocated vcpus: 0 {{(pid=98952) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 25 04:38:51.132715 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Final resource view: name=np0000003587 phys_ram=64301MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:38:48 up 24 min, 2 users, load average: 2.34, 1.48, 0.79\n'} {{(pid=98952) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 25 04:38:51.573511 np0000003587 nova-compute[98952]: INFO nova.scheduler.client.report [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] [req-0d447093-41f4-4d2d-908e-2725944b9f7f] Created resource provider record via placement API for resource provider with UUID e72c7643-c1ab-4c4d-a044-2b10e1a98687 and name np0000003587. Jun 25 04:38:51.622027 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] /sys/module/kvm_amd/parameters/sev contains [N Jun 25 04:38:51.622027 np0000003587 nova-compute[98952]: ] {{(pid=98952) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:2037}} Jun 25 04:38:51.622214 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.host [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] kernel doesn't support AMD SEV Jun 25 04:38:51.622396 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:38:51.622620 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Updating inventory in ProviderTree for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 with inventory: {'MEMORY_MB': {'total': 64301, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 16, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jun 25 04:38:51.622949 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:38:51.626908 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Libvirt baseline CPU Jun 25 04:38:51.626908 np0000003587 nova-compute[98952]: x86_64 Jun 25 04:38:51.626908 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:38:51.626908 np0000003587 nova-compute[98952]: AMD Jun 25 04:38:51.626908 np0000003587 nova-compute[98952]: Jun 25 04:38:51.626908 np0000003587 nova-compute[98952]: Jun 25 04:38:51.626908 np0000003587 nova-compute[98952]: Jun 25 04:38:51.626908 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:13761}} Jun 25 04:38:52.197302 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Updated inventory for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 64301, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 16, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}} Jun 25 04:38:52.197752 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Updating resource provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 generation from 0 to 1 during operation: update_inventory {{(pid=98952) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}} Jun 25 04:38:52.197752 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Updating inventory in ProviderTree for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 with inventory: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jun 25 04:38:52.346642 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Updating resource provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 generation from 1 to 2 during operation: update_traits {{(pid=98952) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}} Jun 25 04:38:52.852879 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Compute_service record updated for np0000003587:np0000003587 {{(pid=98952) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 25 04:38:52.853040 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.234s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:38:52.853211 np0000003587 nova-compute[98952]: DEBUG nova.service [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Creating RPC server for service: nova-compute on topic: compute {{(pid=98952) start /opt/stack/nova/nova/service.py:196}} Jun 25 04:38:52.866178 np0000003587 nova-compute[98952]: DEBUG nova.service [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Creating 2nd RPC server for service: nova-compute on topic: compute-alt {{(pid=98952) start /opt/stack/nova/nova/service.py:212}} Jun 25 04:38:52.878492 np0000003587 nova-compute[98952]: DEBUG nova.service [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] Join ServiceGroup membership for this service compute {{(pid=98952) start /opt/stack/nova/nova/service.py:222}} Jun 25 04:38:52.878670 np0000003587 nova-compute[98952]: DEBUG nova.servicegroup.drivers.db [None req-40f0f85e-48d6-4790-9ba0-9d08a9b0d6eb None None] DB_Driver: join new ServiceGroup member np0000003587 to the compute group, service = {{(pid=98952) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Jun 25 04:38:56.880100 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:38:57.383013 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:38:57.384117 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._threading.loopingcall [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 34.61 seconds {{(pid=98952) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 25 04:38:58.381711 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98952) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 25 04:39:31.996068 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:39:31.996792 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:39:31.997095 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:39:31.997321 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:39:31.997575 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:39:31.997837 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:39:31.998268 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:39:31.998268 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98952) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 25 04:39:31.998500 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:39:32.502618 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:39:32.502618 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:39:32.502618 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:39:32.502618 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Auditing locally available compute resources for np0000003587 (node: np0000003587) {{(pid=98952) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 25 04:39:32.510626 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:39:32.511339 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:39:32.524662 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "env LANG=C uptime" returned: 0 in 0.013s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:39:32.525147 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Hypervisor/Node resource view: name=np0000003587 free_ram=55291MB free_disk=75.09332275390625GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98952) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 25 04:39:32.525270 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:39:32.525513 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:39:33.570806 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Total usable vcpus: 16, total allocated vcpus: 0 {{(pid=98952) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 25 04:39:33.571285 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Final resource view: name=np0000003587 phys_ram=64301MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:39:32 up 24 min, 2 users, load average: 1.78, 1.46, 0.81\n'} {{(pid=98952) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 25 04:39:33.611947 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:39:33.612193 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:39:34.114707 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:39:34.620266 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Compute_service record updated for np0000003587:np0000003587 {{(pid=98952) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 25 04:39:34.620769 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.095s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:39:34.620769 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._threading.loopingcall [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 59.99 seconds {{(pid=98952) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 25 04:40:34.614857 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:40:34.615290 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:40:34.615290 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:40:34.615504 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:40:34.615717 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:40:34.615964 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:40:34.616177 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:40:34.616391 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:40:34.616516 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98952) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 25 04:40:34.616674 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:40:35.120392 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:40:35.120598 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:40:35.120772 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:40:35.120948 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Auditing locally available compute resources for np0000003587 (node: np0000003587) {{(pid=98952) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 25 04:40:35.128770 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:40:35.129603 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:40:35.144775 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "env LANG=C uptime" returned: 0 in 0.015s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:40:35.145131 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Hypervisor/Node resource view: name=np0000003587 free_ram=55307MB free_disk=74.87984848022461GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98952) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 25 04:40:35.145282 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:40:35.145451 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:40:36.198737 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Total usable vcpus: 16, total allocated vcpus: 0 {{(pid=98952) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 25 04:40:36.199267 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Final resource view: name=np0000003587 phys_ram=64301MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:40:35 up 25 min, 2 users, load average: 1.32, 1.40, 0.84\n'} {{(pid=98952) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 25 04:40:36.246599 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:40:36.246863 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:40:36.749709 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:40:37.255865 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Compute_service record updated for np0000003587:np0000003587 {{(pid=98952) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 25 04:40:37.256336 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.111s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:40:37.256336 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._threading.loopingcall [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98952) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 25 04:40:58.384969 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98952) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 25 04:41:04.499624 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "11145d6a-7a4f-4b00-8543-d9b51514d9de" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:04.499624 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "11145d6a-7a4f-4b00-8543-d9b51514d9de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:05.003411 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:41:05.620078 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:05.620078 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:05.626009 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:41:05.626430 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Claim successful on node np0000003587 Jun 25 04:41:06.775639 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:41:06.776774 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:41:07.279312 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:41:07.790680 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.171s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:07.791387 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:41:08.305965 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:41:08.305965 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:41:08.307035 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:08.308622 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:08.811817 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 25 04:41:09.265571 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27ebe4b23b624995a52b9313ff9e318a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d52ed3b8de460eb65a8fb4ad1b015d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:41:09.316876 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Start building block device mappings for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 25 04:41:10.328878 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Start spawning the instance on the hypervisor. {{(pid=98952) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 25 04:41:10.336111 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Creating instance directory {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 25 04:41:10.336418 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Creating image(s) Jun 25 04:41:10.337286 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "/opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:10.337426 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "/opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:10.338051 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "/opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:10.338633 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:10.338921 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:10.704615 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:41:10.710148 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:41:10.710726 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4.part --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:10.805701 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4.part --force-share --output=json" returned: 0 in 0.095s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:10.806786 np0000003587 nova-compute[98952]: DEBUG nova.virt.images [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] 4ecaf199-c1b9-4ce3-869c-178c170c1662 was qcow2, converting to raw {{(pid=98952) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 25 04:41:10.808135 np0000003587 nova-compute[98952]: DEBUG nova.privsep.utils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98952) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 25 04:41:10.808135 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4.part /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4.converted {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:11.047841 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4.part /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4.converted" returned: 0 in 0.239s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:11.055192 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4.converted --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:11.139978 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4.converted --force-share --output=json" returned: 0 in 0.084s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:11.142468 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 0.802s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:11.143017 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:41:11.150142 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:41:11.150302 np0000003587 nova-compute[98952]: INFO oslo.privsep.daemon [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpypmyk1xm/privsep.sock'] Jun 25 04:41:11.158656 np0000003587 sudo[110454]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpypmyk1xm/privsep.sock Jun 25 04:41:11.159429 np0000003587 sudo[110454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 25 04:41:11.461070 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 25 04:41:11.461070 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 25 04:41:11.461070 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 25 04:41:11.461070 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: Jun 25 04:41:11.461070 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 25 04:41:11.461070 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 25 04:41:11.461070 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 25 04:41:11.461070 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: Jun 25 04:41:11.461070 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 25 04:41:11.608657 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Successfully created port: 16a2d9c6-253c-4ce0-84cf-2bfd90c87576 {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:41:11.869864 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 25 04:41:11.870091 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 25 04:41:11.870200 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 25 04:41:11.870348 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: Jun 25 04:41:11.870348 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 25 04:41:11.870534 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 25 04:41:11.870534 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 25 04:41:11.870534 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: Jun 25 04:41:11.870929 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 25 04:41:12.150954 np0000003587 sudo[110454]: pam_unix(sudo:session): session closed for user root Jun 25 04:41:12.152780 np0000003587 nova-compute[98952]: INFO oslo.privsep.daemon [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Spawned new privsep daemon via rootwrap Jun 25 04:41:12.153870 np0000003587 nova-compute[98952]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 25 04:41:12.154013 np0000003587 nova-compute[98952]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 25 04:41:12.154052 np0000003587 nova-compute[98952]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 25 04:41:12.154476 np0000003587 nova-compute[98952]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 110457 Jun 25 04:41:12.267507 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:12.352070 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.084s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:12.352596 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:12.353427 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:12.353981 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:41:12.358626 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:41:12.359153 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:12.439855 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.080s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:12.441439 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk 1073741824 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:12.482499 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk 1073741824" returned: 0 in 0.041s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:12.483133 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.130s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:12.483792 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:12.577959 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.094s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:12.578516 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk. size=1073741824 {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 25 04:41:12.578808 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:12.658575 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:12.659847 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Cannot resize image /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk to a smaller size. {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 25 04:41:12.660446 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Created local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 25 04:41:12.660803 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Ensure instance console log exists: /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:41:12.661204 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:12.661502 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:12.661770 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:13.731649 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Successfully updated port: 16a2d9c6-253c-4ce0-84cf-2bfd90c87576 {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:41:14.236743 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "refresh_cache-11145d6a-7a4f-4b00-8543-d9b51514d9de" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:41:14.236952 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquired lock "refresh_cache-11145d6a-7a4f-4b00-8543-d9b51514d9de" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:41:14.237141 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:41:14.530848 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-b101d26a-6e41-432b-bd95-91b14d5e8ae1 req-3f5bda40-d200-4ee8-a471-a81b5a4dd281 service nova] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Received event network-changed-16a2d9c6-253c-4ce0-84cf-2bfd90c87576 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:41:14.531082 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-b101d26a-6e41-432b-bd95-91b14d5e8ae1 req-3f5bda40-d200-4ee8-a471-a81b5a4dd281 service nova] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Refreshing instance network info cache due to event network-changed-16a2d9c6-253c-4ce0-84cf-2bfd90c87576. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:41:14.531389 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b101d26a-6e41-432b-bd95-91b14d5e8ae1 req-3f5bda40-d200-4ee8-a471-a81b5a4dd281 service nova] Acquiring lock "refresh_cache-11145d6a-7a4f-4b00-8543-d9b51514d9de" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:41:15.531173 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:41:17.236984 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:18.278955 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Updating instance_info_cache with network_info: [{"id": "16a2d9c6-253c-4ce0-84cf-2bfd90c87576", "address": "fa:16:3e:8c:f8:83", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a2d9c6-25", "ovs_interfaceid": "16a2d9c6-253c-4ce0-84cf-2bfd90c87576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:41:18.783878 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Releasing lock "refresh_cache-11145d6a-7a4f-4b00-8543-d9b51514d9de" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:41:18.783878 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Instance network_info: |[{"id": "16a2d9c6-253c-4ce0-84cf-2bfd90c87576", "address": "fa:16:3e:8c:f8:83", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a2d9c6-25", "ovs_interfaceid": "16a2d9c6-253c-4ce0-84cf-2bfd90c87576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 25 04:41:18.787449 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Start _get_guest_xml network_info=[{"id": "16a2d9c6-253c-4ce0-84cf-2bfd90c87576", "address": "fa:16:3e:8c:f8:83", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a2d9c6-25", "ovs_interfaceid": "16a2d9c6-253c-4ce0-84cf-2bfd90c87576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '4ecaf199-c1b9-4ce3-869c-178c170c1662'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:41:18.788301 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b101d26a-6e41-432b-bd95-91b14d5e8ae1 req-3f5bda40-d200-4ee8-a471-a81b5a4dd281 service nova] Acquired lock "refresh_cache-11145d6a-7a4f-4b00-8543-d9b51514d9de" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:41:18.788301 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-b101d26a-6e41-432b-bd95-91b14d5e8ae1 req-3f5bda40-d200-4ee8-a471-a81b5a4dd281 service nova] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Refreshing network info cache for port 16a2d9c6-253c-4ce0-84cf-2bfd90c87576 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:41:18.791207 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:41:18.795141 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-2130958277', uuid='11145d6a-7a4f-4b00-8543-d9b51514d9de'), owner=OwnerMeta(userid='27ebe4b23b624995a52b9313ff9e318a', username='tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member', projectid='a5d52ed3b8de460eb65a8fb4ad1b015d', projectname='tempest-ServerBootFromVolumeStableRescueTest-6878904'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "16a2d9c6-253c-4ce0-84cf-2bfd90c87576", "address": "fa:16:3e:8c:f8:83", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a2d9c6-25", "ovs_interfaceid": "16a2d9c6-253c-4ce0-84cf-2bfd90c87576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362478.792224) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:41:18.795141 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:41:18.795141 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:41:18.795848 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:41:18.796614 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:41:18.797874 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:41:18.798270 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:41:18.800078 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:41:18.800078 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:41:18.800078 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:41:18.800078 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:41:18.800078 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:41:18.800078 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:41:18.800078 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:41:18.800078 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:41:18.800078 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:41:18.800078 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:41:18.816416 np0000003587 nova-compute[98952]: DEBUG nova.privsep.utils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98952) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 25 04:41:18.817823 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:41:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2130958277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-serverbootfromvolumestablerescuetest-server-2130958277',id=1,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5d52ed3b8de460eb65a8fb4ad1b015d',ramdisk_id='',reservation_id='r-s6lu4wsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-6878904',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:41:09Z,user_data=None,user_id='27ebe4b23b624995a52b9313ff9e318a',uuid=11145d6a-7a4f-4b00-8543-d9b51514d9de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16a2d9c6-253c-4ce0-84cf-2bfd90c87576", "address": "fa:16:3e:8c:f8:83", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a2d9c6-25", "ovs_interfaceid": "16a2d9c6-253c-4ce0-84cf-2bfd90c87576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:41:18.818082 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converting VIF {"id": "16a2d9c6-253c-4ce0-84cf-2bfd90c87576", "address": "fa:16:3e:8c:f8:83", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a2d9c6-25", "ovs_interfaceid": "16a2d9c6-253c-4ce0-84cf-2bfd90c87576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:41:18.819253 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f8:83,bridge_name='br-int',has_traffic_filtering=True,id=16a2d9c6-253c-4ce0-84cf-2bfd90c87576,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a2d9c6-25') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:41:18.820977 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'pci_devices' on Instance uuid 11145d6a-7a4f-4b00-8543-d9b51514d9de {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:41:19.294985 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-b101d26a-6e41-432b-bd95-91b14d5e8ae1 req-3f5bda40-d200-4ee8-a471-a81b5a4dd281 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] End _get_guest_xml xml= Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: 11145d6a-7a4f-4b00-8543-d9b51514d9de Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: instance-00000001 Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: 196608 Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: tempest-ServerBootFromVolumeStableRescueTest-server-2130958277 Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: 2026-06-25 04:41:18 Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: 192 Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: 0 Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: 0 Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: True Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: bare Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: 0 Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: virtio Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: tempest-ServerBootFromVolumeStableRescueTest-6878904 Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: 11145d6a-7a4f-4b00-8543-d9b51514d9de Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: 11145d6a-7a4f-4b00-8543-d9b51514d9de Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: hvm Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: 128 Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Preparing to wait for external event network-vif-plugged-16a2d9c6-253c-4ce0-84cf-2bfd90c87576 {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "11145d6a-7a4f-4b00-8543-d9b51514d9de-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:19.333518 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "11145d6a-7a4f-4b00-8543-d9b51514d9de-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:19.347984 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "11145d6a-7a4f-4b00-8543-d9b51514d9de-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:19.347984 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:41:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2130958277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-serverbootfromvolumestablerescuetest-server-2130958277',id=1,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5d52ed3b8de460eb65a8fb4ad1b015d',ramdisk_id='',reservation_id='r-s6lu4wsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-6878904',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:41:09Z,user_data=None,user_id='27ebe4b23b624995a52b9313ff9e318a',uuid=11145d6a-7a4f-4b00-8543-d9b51514d9de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16a2d9c6-253c-4ce0-84cf-2bfd90c87576", "address": "fa:16:3e:8c:f8:83", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a2d9c6-25", "ovs_interfaceid": "16a2d9c6-253c-4ce0-84cf-2bfd90c87576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:41:19.347984 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converting VIF {"id": "16a2d9c6-253c-4ce0-84cf-2bfd90c87576", "address": "fa:16:3e:8c:f8:83", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a2d9c6-25", "ovs_interfaceid": "16a2d9c6-253c-4ce0-84cf-2bfd90c87576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:41:19.348423 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f8:83,bridge_name='br-int',has_traffic_filtering=True,id=16a2d9c6-253c-4ce0-84cf-2bfd90c87576,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a2d9c6-25') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:41:19.348423 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f8:83,bridge_name='br-int',has_traffic_filtering=True,id=16a2d9c6-253c-4ce0-84cf-2bfd90c87576,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a2d9c6-25') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:41:19.383387 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Created schema index Interface.name {{(pid=98952) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Jun 25 04:41:19.383387 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Created schema index Port.name {{(pid=98952) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Jun 25 04:41:19.383387 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Created schema index Bridge.name {{(pid=98952) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Jun 25 04:41:19.383387 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=98952) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jun 25 04:41:19.383387 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [POLLOUT] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:19.383387 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98952) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jun 25 04:41:19.384871 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:19.387069 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:19.411984 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:19.433641 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:19.433973 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:19.436799 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:41:19.436799 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:19.436799 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b773af20-4eba-5138-9157-0d31fb6793ce', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:19.436799 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:19.437588 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:41:19.450093 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:19.453363 np0000003587 nova-compute[98952]: INFO oslo.privsep.daemon [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpek5m2drj/privsep.sock'] Jun 25 04:41:19.462441 np0000003587 sudo[110599]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpek5m2drj/privsep.sock Jun 25 04:41:19.463362 np0000003587 sudo[110599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 25 04:41:19.760099 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 25 04:41:19.760262 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 25 04:41:19.760262 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 25 04:41:19.760347 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: Jun 25 04:41:19.760347 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 25 04:41:19.760477 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 25 04:41:19.760477 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 25 04:41:19.760590 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: Jun 25 04:41:19.760708 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 25 04:41:19.773303 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:20.103091 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 25 04:41:20.103206 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 25 04:41:20.103375 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 25 04:41:20.105257 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: Jun 25 04:41:20.105412 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 25 04:41:20.105412 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 25 04:41:20.105503 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 25 04:41:20.105550 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: Jun 25 04:41:20.108180 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 25 04:41:20.405360 np0000003587 sudo[110599]: pam_unix(sudo:session): session closed for user root Jun 25 04:41:20.406955 np0000003587 nova-compute[98952]: INFO oslo.privsep.daemon [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Spawned new privsep daemon via rootwrap Jun 25 04:41:20.408675 np0000003587 nova-compute[98952]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 25 04:41:20.408675 np0000003587 nova-compute[98952]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 25 04:41:20.408675 np0000003587 nova-compute[98952]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none Jun 25 04:41:20.408675 np0000003587 nova-compute[98952]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 110618 Jun 25 04:41:20.458012 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-b101d26a-6e41-432b-bd95-91b14d5e8ae1 req-3f5bda40-d200-4ee8-a471-a81b5a4dd281 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:20.462813 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "9333a704-82ad-4b54-8456-59eb035a2512" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:20.462813 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "9333a704-82ad-4b54-8456-59eb035a2512" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:20.730269 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:20.730327 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16a2d9c6-25, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:20.730823 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16a2d9c6-25, col_values=(('qos', UUID('3b38a9ef-3e97-49aa-89d3-4cfbee89c13c')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:20.731787 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16a2d9c6-25, col_values=(('external_ids', {'iface-id': '16a2d9c6-253c-4ce0-84cf-2bfd90c87576', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:f8:83', 'vm-uuid': '11145d6a-7a4f-4b00-8543-d9b51514d9de'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:20.735746 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-b101d26a-6e41-432b-bd95-91b14d5e8ae1 req-3f5bda40-d200-4ee8-a471-a81b5a4dd281 service nova] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Updated VIF entry in instance network info cache for port 16a2d9c6-253c-4ce0-84cf-2bfd90c87576. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:41:20.736141 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-b101d26a-6e41-432b-bd95-91b14d5e8ae1 req-3f5bda40-d200-4ee8-a471-a81b5a4dd281 service nova] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Updating instance_info_cache with network_info: [{"id": "16a2d9c6-253c-4ce0-84cf-2bfd90c87576", "address": "fa:16:3e:8c:f8:83", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a2d9c6-25", "ovs_interfaceid": "16a2d9c6-253c-4ce0-84cf-2bfd90c87576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:41:20.737272 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:20.738946 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:41:20.744185 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:20.746387 np0000003587 nova-compute[98952]: INFO os_vif [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f8:83,bridge_name='br-int',has_traffic_filtering=True,id=16a2d9c6-253c-4ce0-84cf-2bfd90c87576,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a2d9c6-25') Jun 25 04:41:20.966249 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:41:21.114161 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Acquiring lock "5e52bd75-8566-4472-8147-99655013bc83" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:21.114420 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "5e52bd75-8566-4472-8147-99655013bc83" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:21.240393 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b101d26a-6e41-432b-bd95-91b14d5e8ae1 req-3f5bda40-d200-4ee8-a471-a81b5a4dd281 service nova] Releasing lock "refresh_cache-11145d6a-7a4f-4b00-8543-d9b51514d9de" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:41:21.410984 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:21.550139 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:21.550454 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:21.554051 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:41:21.554280 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Claim successful on node np0000003587 Jun 25 04:41:21.617166 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:41:21.923642 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Acquiring lock "c3fade0a-4409-4f45-b07c-7323fbd836bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:21.923993 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Lock "c3fade0a-4409-4f45-b07c-7323fbd836bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:22.105928 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-5fa5393a-3cec-433f-bf86-a034eda7f3a8 req-232ebed2-8f68-45d6-b03f-d21ebb70982b service nova] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Received event network-vif-unplugged-16a2d9c6-253c-4ce0-84cf-2bfd90c87576 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:41:22.106390 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-5fa5393a-3cec-433f-bf86-a034eda7f3a8 req-232ebed2-8f68-45d6-b03f-d21ebb70982b service nova] Acquiring lock "11145d6a-7a4f-4b00-8543-d9b51514d9de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:22.106390 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-5fa5393a-3cec-433f-bf86-a034eda7f3a8 req-232ebed2-8f68-45d6-b03f-d21ebb70982b service nova] Lock "11145d6a-7a4f-4b00-8543-d9b51514d9de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:22.106390 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-5fa5393a-3cec-433f-bf86-a034eda7f3a8 req-232ebed2-8f68-45d6-b03f-d21ebb70982b service nova] Lock "11145d6a-7a4f-4b00-8543-d9b51514d9de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:22.106545 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-5fa5393a-3cec-433f-bf86-a034eda7f3a8 req-232ebed2-8f68-45d6-b03f-d21ebb70982b service nova] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] No event matching network-vif-unplugged-16a2d9c6-253c-4ce0-84cf-2bfd90c87576 in dict_keys([('network-vif-plugged', '16a2d9c6-253c-4ce0-84cf-2bfd90c87576')]) {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 25 04:41:22.106652 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-5fa5393a-3cec-433f-bf86-a034eda7f3a8 req-232ebed2-8f68-45d6-b03f-d21ebb70982b service nova] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Received unexpected event network-vif-unplugged-16a2d9c6-253c-4ce0-84cf-2bfd90c87576 for instance with vm_state building and task_state spawning. Jun 25 04:41:22.184437 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:22.280092 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:41:22.280331 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:41:22.280466 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] No VIF found with MAC fa:16:3e:8c:f8:83, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:41:22.281592 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Using config drive Jun 25 04:41:22.426045 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:41:22.787688 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:22.889257 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:41:22.889604 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:41:23.009786 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:23.349725 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Creating config drive at /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk.config Jun 25 04:41:23.353457 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvsgqk2_o {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:23.386348 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvsgqk2_o" returned: 0 in 0.032s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:23.393655 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:41:23.872146 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Acquiring lock "54721bc9-c45c-4cb1-9910-f47334e84cd2" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:23.872146 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Lock "54721bc9-c45c-4cb1-9910-f47334e84cd2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:23.903026 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.353s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:23.903624 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:41:23.907590 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.723s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:23.912925 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:41:23.913130 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Claim successful on node np0000003587 Jun 25 04:41:23.918071 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:23.937212 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:24.065104 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:24.071418 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:24.373723 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:41:24.416750 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:41:24.416750 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:41:24.416750 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:24.416750 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:24.501810 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:24.547627 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:24.554207 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '947bde0e827c45f5bab008d094816d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284d191aa82f453cabcfd18172f74099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:41:24.775925 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:24.918298 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 25 04:41:24.945999 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:25.160833 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [-] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:41:25.161282 np0000003587 nova-compute[98952]: INFO nova.compute.manager [-] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] VM Started (Lifecycle Event) Jun 25 04:41:25.368336 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:41:25.368816 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:41:25.422349 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Start building block device mappings for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 25 04:41:25.666170 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:41:25.668084 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Paused> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:41:25.668357 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] VM Paused (Lifecycle Event) Jun 25 04:41:25.738273 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Successfully created port: 5c0f7808-e34f-40a7-8f2d-38eace20dd0a {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:41:25.740995 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:25.872952 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:41:25.927304 np0000003587 nova-compute[98952]: INFO nova.virt.block_device [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Booting with volume 806b0e55-d716-447a-87d8-208a72ab2232 at /dev/vda Jun 25 04:41:26.012225 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.80', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003587', 'execute': None}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:41:26.013026 np0000003587 nova-compute[98952]: INFO oslo.privsep.daemon [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpe7lj7ff8/privsep.sock'] Jun 25 04:41:26.022003 np0000003587 sudo[110783]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpe7lj7ff8/privsep.sock Jun 25 04:41:26.022757 np0000003587 sudo[110783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 25 04:41:26.173178 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:41:26.179167 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:41:26.312844 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 25 04:41:26.313028 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 25 04:41:26.313028 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 25 04:41:26.313084 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: Jun 25 04:41:26.313145 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 25 04:41:26.313181 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 25 04:41:26.313229 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 25 04:41:26.313308 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: Jun 25 04:41:26.313308 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 25 04:41:26.382608 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.476s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:26.383422 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:41:26.386909 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.377s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:26.390455 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:41:26.390621 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Claim successful on node np0000003587 Jun 25 04:41:26.511350 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Successfully updated port: 5c0f7808-e34f-40a7-8f2d-38eace20dd0a {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:41:26.682837 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] During sync_power_state the instance has a pending task (spawning). Skip. Jun 25 04:41:26.686352 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 25 04:41:26.686460 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 25 04:41:26.686518 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 25 04:41:26.686677 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: Jun 25 04:41:26.686756 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 25 04:41:26.687193 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 25 04:41:26.687193 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 25 04:41:26.687193 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: Jun 25 04:41:26.687193 np0000003587 nova-compute[98952]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 25 04:41:26.893185 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:41:26.893401 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:41:26.894599 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:26.896660 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:27.015291 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "refresh_cache-9333a704-82ad-4b54-8456-59eb035a2512" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:41:27.015291 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquired lock "refresh_cache-9333a704-82ad-4b54-8456-59eb035a2512" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:41:27.015291 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:41:27.024178 np0000003587 nova-compute[98952]: INFO oslo.privsep.daemon [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Spawned new privsep daemon via rootwrap Jun 25 04:41:27.019918 np0000003587 sudo[110783]: pam_unix(sudo:session): session closed for user root Jun 25 04:41:27.040935 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '653ba57c4bcc479ea05a45ac7b213b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c31b6cf6f5f4fff90914e329442d042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:41:27.161905 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:27.163539 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:27.169221 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:27.182290 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:27.183161 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.scaleio [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98952) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 25 04:41:27.183710 np0000003587 nova-compute[98952]: WARNING os_brick.initiator.connectors.nvmeof [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath' Jun 25 04:41:27.208929 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): nvme version {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:27.228334 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] 'nvme version' failed. Not Retrying. {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 04:41:27.229268 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] nvme not present on system {{(pid=98952) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 25 04:41:27.240147 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98952) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 25 04:41:27.241717 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.lightos [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Current host hostNQN and IP(s) are ['10.4.3.80', 'fe80::f816:3eff:feea:dfe4', '192.168.40.6', 'fe80::f816:3eff:fe4f:7c42', '192.168.50.6', 'fe80::f816:3eff:fe6c:e6a6', '192.168.10.6', 'fe80::f816:3eff:fe17:d749', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::b035:28ff:fe70:6f4a', 'fe80::fc16:3eff:fe8c:f883', 'fe80::483f:f2ff:fe48:75ca'] Jun 25 04:41:27.241907 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 25 04:41:27.242064 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] LIGHTOS: no hostnqn found. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 25 04:41:27.243458 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] <== get_connector_properties: return (1229ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.80', 'host': 'np0000003587', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c81886224652', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a1feb13-40e2-4ac6-989e-b08a6fc0f283', 'nvme_native_multipath': False} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:41:27.244268 np0000003587 nova-compute[98952]: DEBUG nova.virt.block_device [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Updating existing volume attachment record: 519dfcf5-2e40-4010-8f8c-8ddf8d43aefa {{(pid=98952) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 25 04:41:27.279155 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-dc6bf706-d33d-413d-8e0d-c7822f498e29 req-40e52547-e758-487d-913a-2bccaf237051 service nova] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Received event network-changed-5c0f7808-e34f-40a7-8f2d-38eace20dd0a {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:41:27.279287 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-dc6bf706-d33d-413d-8e0d-c7822f498e29 req-40e52547-e758-487d-913a-2bccaf237051 service nova] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Refreshing instance network info cache due to event network-changed-5c0f7808-e34f-40a7-8f2d-38eace20dd0a. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:41:27.279975 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-dc6bf706-d33d-413d-8e0d-c7822f498e29 req-40e52547-e758-487d-913a-2bccaf237051 service nova] Acquiring lock "refresh_cache-9333a704-82ad-4b54-8456-59eb035a2512" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:41:27.408527 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names Jun 25 04:41:27.706316 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:41:27.838529 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:41:27.838836 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:41:27.883972 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Successfully created port: 816a6c6d-d655-46f8-9f8e-7b6bde2e2e50 {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:41:27.914937 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Start building block device mappings for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 25 04:41:27.936904 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:27.992439 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:28.090081 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Updating instance_info_cache with network_info: [{"id": "5c0f7808-e34f-40a7-8f2d-38eace20dd0a", "address": "fa:16:3e:78:7a:c8", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c0f7808-e3", "ovs_interfaceid": "5c0f7808-e34f-40a7-8f2d-38eace20dd0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:41:28.342615 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:41:28.567810 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Successfully updated port: 816a6c6d-d655-46f8-9f8e-7b6bde2e2e50 {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:41:28.592478 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Releasing lock "refresh_cache-9333a704-82ad-4b54-8456-59eb035a2512" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:41:28.592926 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Instance network_info: |[{"id": "5c0f7808-e34f-40a7-8f2d-38eace20dd0a", "address": "fa:16:3e:78:7a:c8", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c0f7808-e3", "ovs_interfaceid": "5c0f7808-e34f-40a7-8f2d-38eace20dd0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 25 04:41:28.593595 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-dc6bf706-d33d-413d-8e0d-c7822f498e29 req-40e52547-e758-487d-913a-2bccaf237051 service nova] Acquired lock "refresh_cache-9333a704-82ad-4b54-8456-59eb035a2512" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:41:28.593774 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-dc6bf706-d33d-413d-8e0d-c7822f498e29 req-40e52547-e758-487d-913a-2bccaf237051 service nova] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Refreshing network info cache for port 5c0f7808-e34f-40a7-8f2d-38eace20dd0a {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:41:28.852911 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.466s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:28.853441 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:41:28.856030 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.911s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:28.858676 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:41:28.858811 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Claim successful on node np0000003587 Jun 25 04:41:28.924883 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Start spawning the instance on the hypervisor. {{(pid=98952) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 25 04:41:28.926483 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Creating instance directory {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 25 04:41:28.927961 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Creating image(s) Jun 25 04:41:28.928411 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e52bd75-8566-4472-8147-99655013bc83/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:28.928620 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "/opt/stack/data/nova/instances/5e52bd75-8566-4472-8147-99655013bc83/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:28.929103 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "/opt/stack/data/nova/instances/5e52bd75-8566-4472-8147-99655013bc83/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:28.929346 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Acquiring lock "bf16e3c7882b9e7ea52633a923fa87fe6d666a3e" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:28.929751 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "bf16e3c7882b9e7ea52633a923fa87fe6d666a3e" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:29.070302 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Acquiring lock "refresh_cache-5e52bd75-8566-4472-8147-99655013bc83" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:41:29.070585 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Acquired lock "refresh_cache-5e52bd75-8566-4472-8147-99655013bc83" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:41:29.070585 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:41:29.097092 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-dc6bf706-d33d-413d-8e0d-c7822f498e29 req-40e52547-e758-487d-913a-2bccaf237051 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:29.361077 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:41:29.361193 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:41:29.361469 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:29.361898 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:29.384182 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6063bb01-2dd5-4d8b-bb84-baed15448c17 req-08a30455-49b7-458c-aa59-5571f86e9c78 service nova] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Received event network-changed-816a6c6d-d655-46f8-9f8e-7b6bde2e2e50 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:41:29.384843 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6063bb01-2dd5-4d8b-bb84-baed15448c17 req-08a30455-49b7-458c-aa59-5571f86e9c78 service nova] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Refreshing instance network info cache due to event network-changed-816a6c6d-d655-46f8-9f8e-7b6bde2e2e50. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:41:29.384843 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6063bb01-2dd5-4d8b-bb84-baed15448c17 req-08a30455-49b7-458c-aa59-5571f86e9c78 service nova] Acquiring lock "refresh_cache-5e52bd75-8566-4472-8147-99655013bc83" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:41:29.405766 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Start spawning the instance on the hypervisor. {{(pid=98952) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 25 04:41:29.406539 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Creating instance directory {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 25 04:41:29.406789 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Creating image(s) Jun 25 04:41:29.407045 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Did not create local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 25 04:41:29.407148 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Ensure instance console log exists: /opt/stack/data/nova/instances/9333a704-82ad-4b54-8456-59eb035a2512/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:41:29.407337 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:29.410414 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:29.410540 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:29.411008 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Start _get_guest_xml network_info=[{"id": "5c0f7808-e34f-40a7-8f2d-38eace20dd0a", "address": "fa:16:3e:78:7a:c8", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c0f7808-e3", "ovs_interfaceid": "5c0f7808-e34f-40a7-8f2d-38eace20dd0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '806b0e55-d716-447a-87d8-208a72ab2232', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9333a704-82ad-4b54-8456-59eb035a2512', 'attached_at': '', 'detached_at': '', 'volume_id': '806b0e55-d716-447a-87d8-208a72ab2232', 'serial': '806b0e55-d716-447a-87d8-208a72ab2232', 'multiattach': True}, 'attachment_id': '519dfcf5-2e40-4010-8f8c-8ddf8d43aefa', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:41:29.421106 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:41:29.423206 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-16129467', uuid='9333a704-82ad-4b54-8456-59eb035a2512'), owner=OwnerMeta(userid='947bde0e827c45f5bab008d094816d8c', username='tempest-AttachVolumeMultiAttachTest-1256899935-project-member', projectid='284d191aa82f453cabcfd18172f74099', projectname='tempest-AttachVolumeMultiAttachTest-1256899935'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5c0f7808-e34f-40a7-8f2d-38eace20dd0a", "address": "fa:16:3e:78:7a:c8", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c0f7808-e3", "ovs_interfaceid": "5c0f7808-e34f-40a7-8f2d-38eace20dd0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362489.4226675) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:41:29.425544 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:41:29.426126 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:41:29.427191 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:41:29.427481 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:41:29.428838 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:41:29.429172 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:41:29.429452 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:41:29.429452 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:41:29.429571 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:41:29.429672 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:41:29.429831 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:41:29.429984 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:41:29.430129 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:41:29.430270 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:41:29.430398 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:41:29.430794 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:41:29.443836 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:29.443836 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:29.445501 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connector [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Factory for ISCSI on None {{(pid=98952) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 25 04:41:29.445736 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" :: held 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:29.445925 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Calling os-brick to attach iSCSI Volume {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 25 04:41:29.446154 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '806b0e55-d716-447a-87d8-208a72ab2232', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:41:29.446480 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:41:29.447007 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:41:29.447858 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '806b0e55-d716-447a-87d8-208a72ab2232', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 25 04:41:29.453349 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '950b42e61fcf44b5bf32db2678cf1907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb9320b8eea43c5a20e2a3fcfb2c3dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:41:29.465497 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:41:29.467742 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:41:29.467938 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:41:29.468461 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:41:29.469240 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:41:29.469240 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:41:29.481341 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:41:29.481341 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:41:29.491723 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:41:29.491723 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:41:29.507745 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232] added Jun 25 04:41:29.507745 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:41:29.507745 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:41:29.507745 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:41:29.507745 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:41:29.507745 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:41:29.507745 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:41:29.507745 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:41:29.507745 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0396(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:41:29.508091 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:41:29.514162 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232] added Jun 25 04:41:29.514162 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:41:29.514162 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:41:29.514162 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:41:29.514162 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:41:29.514162 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:41:29.514162 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:41:29.515009 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:41:29.515009 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0454(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:41:29.515009 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:41:29.543332 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-dc6bf706-d33d-413d-8e0d-c7822f498e29 req-40e52547-e758-487d-913a-2bccaf237051 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:29.748729 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:41:29.776765 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:29.791528 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-dc6bf706-d33d-413d-8e0d-c7822f498e29 req-40e52547-e758-487d-913a-2bccaf237051 service nova] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Updated VIF entry in instance network info cache for port 5c0f7808-e34f-40a7-8f2d-38eace20dd0a. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:41:29.791848 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-dc6bf706-d33d-413d-8e0d-c7822f498e29 req-40e52547-e758-487d-913a-2bccaf237051 service nova] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Updating instance_info_cache with network_info: [{"id": "5c0f7808-e34f-40a7-8f2d-38eace20dd0a", "address": "fa:16:3e:78:7a:c8", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c0f7808-e3", "ovs_interfaceid": "5c0f7808-e34f-40a7-8f2d-38eace20dd0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:41:29.863292 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 25 04:41:29.894129 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:41:29.898231 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:41:29.898624 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf16e3c7882b9e7ea52633a923fa87fe6d666a3e.part --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:29.993490 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf16e3c7882b9e7ea52633a923fa87fe6d666a3e.part --force-share --output=json" returned: 0 in 0.095s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:29.994383 np0000003587 nova-compute[98952]: DEBUG nova.virt.images [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] 19d144f4-084b-4c62-939d-d67ccdaa4e70 was qcow2, converting to raw {{(pid=98952) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 25 04:41:29.995058 np0000003587 nova-compute[98952]: DEBUG nova.privsep.utils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98952) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 25 04:41:29.995303 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf16e3c7882b9e7ea52633a923fa87fe6d666a3e.part /opt/stack/data/nova/instances/_base/bf16e3c7882b9e7ea52633a923fa87fe6d666a3e.converted {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:30.276217 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf16e3c7882b9e7ea52633a923fa87fe6d666a3e.part /opt/stack/data/nova/instances/_base/bf16e3c7882b9e7ea52633a923fa87fe6d666a3e.converted" returned: 0 in 0.280s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:30.283648 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf16e3c7882b9e7ea52633a923fa87fe6d666a3e.converted --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:30.297511 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-dc6bf706-d33d-413d-8e0d-c7822f498e29 req-40e52547-e758-487d-913a-2bccaf237051 service nova] Releasing lock "refresh_cache-9333a704-82ad-4b54-8456-59eb035a2512" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:41:30.302905 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:41:30.303214 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:41:30.362623 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf16e3c7882b9e7ea52633a923fa87fe6d666a3e.converted --force-share --output=json" returned: 0 in 0.079s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:30.363305 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "bf16e3c7882b9e7ea52633a923fa87fe6d666a3e" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.433s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:30.363787 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:41:30.367268 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:41:30.368425 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf16e3c7882b9e7ea52633a923fa87fe6d666a3e --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:30.384949 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Start building block device mappings for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 25 04:41:30.430843 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf16e3c7882b9e7ea52633a923fa87fe6d666a3e --force-share --output=json" returned: 0 in 0.062s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:30.435088 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Acquiring lock "bf16e3c7882b9e7ea52633a923fa87fe6d666a3e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:30.435641 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "bf16e3c7882b9e7ea52633a923fa87fe6d666a3e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:30.436178 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:41:30.440455 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:41:30.441757 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf16e3c7882b9e7ea52633a923fa87fe6d666a3e --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:30.508707 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:41:30.515336 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:41:30.517912 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf16e3c7882b9e7ea52633a923fa87fe6d666a3e --force-share --output=json" returned: 0 in 0.077s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:30.518401 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf16e3c7882b9e7ea52633a923fa87fe6d666a3e,backing_fmt=raw /opt/stack/data/nova/instances/5e52bd75-8566-4472-8147-99655013bc83/disk 1073741824 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.40.100 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:41:30.529164 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:41:30.538977 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.50.100 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:41:30.543311 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:41:30.545789 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:41:30.558050 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:41:30.560074 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jun 25 04:41:30.560074 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:41:30.560251 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jun 25 04:41:30.560251 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:41:30.560444 np0000003587 nova-compute[98952]: WARNING os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jun 25 04:41:30.560444 np0000003587 nova-compute[98952]: Jun 25 04:41:30.561090 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf16e3c7882b9e7ea52633a923fa87fe6d666a3e,backing_fmt=raw /opt/stack/data/nova/instances/5e52bd75-8566-4472-8147-99655013bc83/disk 1073741824" returned: 0 in 0.043s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:30.561490 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "bf16e3c7882b9e7ea52633a923fa87fe6d666a3e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.126s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:30.561850 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf16e3c7882b9e7ea52633a923fa87fe6d666a3e --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:30.575401 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jun 25 04:41:30.575401 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:41:30.575401 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jun 25 04:41:30.575401 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:41:30.575401 np0000003587 nova-compute[98952]: WARNING os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jun 25 04:41:30.575401 np0000003587 nova-compute[98952]: Jun 25 04:41:30.638608 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf16e3c7882b9e7ea52633a923fa87fe6d666a3e --force-share --output=json" returned: 0 in 0.077s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:30.639925 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e52bd75-8566-4472-8147-99655013bc83/disk. size=1073741824 {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 25 04:41:30.640323 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e52bd75-8566-4472-8147-99655013bc83/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:30.666292 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Successfully created port: 0030c2aa-ca73-4a59-a23c-2b1e3864d2fb {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:41:30.716663 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e52bd75-8566-4472-8147-99655013bc83/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:30.717178 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Cannot resize image /opt/stack/data/nova/instances/5e52bd75-8566-4472-8147-99655013bc83/disk to a smaller size. {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 25 04:41:30.717609 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Created local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 25 04:41:30.717692 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Ensure instance console log exists: /opt/stack/data/nova/instances/5e52bd75-8566-4472-8147-99655013bc83/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:41:30.718004 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:30.718330 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:30.718330 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:30.742289 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:30.807521 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:41:30.835763 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Updating instance_info_cache with network_info: [{"id": "816a6c6d-d655-46f8-9f8e-7b6bde2e2e50", "address": "fa:16:3e:5d:a0:ff", "network": {"id": "0c192e32-6947-44e6-b8c5-07d6f5f711af", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-940608449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c31b6cf6f5f4fff90914e329442d042", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap816a6c6d-d6", "ovs_interfaceid": "816a6c6d-d655-46f8-9f8e-7b6bde2e2e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:41:30.840985 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-b768978f-9cad-468f-b357-8c109ef4a46c req-bc61c8f2-d98d-4cde-bf92-3000d9b89299 service nova] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Received event network-vif-plugged-16a2d9c6-253c-4ce0-84cf-2bfd90c87576 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:41:30.841103 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b768978f-9cad-468f-b357-8c109ef4a46c req-bc61c8f2-d98d-4cde-bf92-3000d9b89299 service nova] Acquiring lock "11145d6a-7a4f-4b00-8543-d9b51514d9de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:30.841441 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b768978f-9cad-468f-b357-8c109ef4a46c req-bc61c8f2-d98d-4cde-bf92-3000d9b89299 service nova] Lock "11145d6a-7a4f-4b00-8543-d9b51514d9de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:30.841441 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b768978f-9cad-468f-b357-8c109ef4a46c req-bc61c8f2-d98d-4cde-bf92-3000d9b89299 service nova] Lock "11145d6a-7a4f-4b00-8543-d9b51514d9de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:30.841498 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-b768978f-9cad-468f-b357-8c109ef4a46c req-bc61c8f2-d98d-4cde-bf92-3000d9b89299 service nova] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Processing event network-vif-plugged-16a2d9c6-253c-4ce0-84cf-2bfd90c87576 {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:41:30.842581 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Instance event wait completed in 5 seconds for network-vif-plugged {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:41:30.849857 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:41:30.849857 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] VM Resumed (Lifecycle Event) Jun 25 04:41:30.855169 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Guest created on hypervisor {{(pid=98952) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 25 04:41:30.858131 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Instance spawned successfully. Jun 25 04:41:30.858493 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 25 04:41:31.317427 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.461s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:31.318071 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:41:31.338949 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Releasing lock "refresh_cache-5e52bd75-8566-4472-8147-99655013bc83" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:41:31.339255 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Instance network_info: |[{"id": "816a6c6d-d655-46f8-9f8e-7b6bde2e2e50", "address": "fa:16:3e:5d:a0:ff", "network": {"id": "0c192e32-6947-44e6-b8c5-07d6f5f711af", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-940608449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c31b6cf6f5f4fff90914e329442d042", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap816a6c6d-d6", "ovs_interfaceid": "816a6c6d-d655-46f8-9f8e-7b6bde2e2e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 25 04:41:31.341728 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Start _get_guest_xml network_info=[{"id": "816a6c6d-d655-46f8-9f8e-7b6bde2e2e50", "address": "fa:16:3e:5d:a0:ff", "network": {"id": "0c192e32-6947-44e6-b8c5-07d6f5f711af", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-940608449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c31b6cf6f5f4fff90914e329442d042", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap816a6c6d-d6", "ovs_interfaceid": "816a6c6d-d655-46f8-9f8e-7b6bde2e2e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:41:10Z,direct_url=,disk_format='qcow2',id=19d144f4-084b-4c62-939d-d67ccdaa4e70,min_disk=0,min_ram=0,name='',owner='9f495a79e34349dcb1930df0038204fa',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:41:13Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'guest_format': None, 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'disk_bus': 'scsi', 'encrypted': False, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '19d144f4-084b-4c62-939d-d67ccdaa4e70'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:41:31.343184 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6063bb01-2dd5-4d8b-bb84-baed15448c17 req-08a30455-49b7-458c-aa59-5571f86e9c78 service nova] Acquired lock "refresh_cache-5e52bd75-8566-4472-8147-99655013bc83" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:41:31.343184 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-6063bb01-2dd5-4d8b-bb84-baed15448c17 req-08a30455-49b7-458c-aa59-5571f86e9c78 service nova] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Refreshing network info cache for port 816a6c6d-d655-46f8-9f8e-7b6bde2e2e50 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:41:31.346947 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:41:31.348319 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d144f4-084b-4c62-939d-d67ccdaa4e70', instance_meta=NovaInstanceMeta(name='tempest-AttachSCSIVolumeTestJSON-server-613777004', uuid='5e52bd75-8566-4472-8147-99655013bc83'), owner=OwnerMeta(userid='653ba57c4bcc479ea05a45ac7b213b1e', username='tempest-AttachSCSIVolumeTestJSON-717482791-project-member', projectid='6c31b6cf6f5f4fff90914e329442d042', projectname='tempest-AttachSCSIVolumeTestJSON-717482791'), image=ImageMeta(id='19d144f4-084b-4c62-939d-d67ccdaa4e70', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'scsi', 'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "816a6c6d-d655-46f8-9f8e-7b6bde2e2e50", "address": "fa:16:3e:5d:a0:ff", "network": {"id": "0c192e32-6947-44e6-b8c5-07d6f5f711af", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-940608449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c31b6cf6f5f4fff90914e329442d042", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap816a6c6d-d6", "ovs_interfaceid": "816a6c6d-d655-46f8-9f8e-7b6bde2e2e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362491.3479667) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:41:31.349893 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:41:31.350287 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:41:31.351243 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:41:31.352128 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:41:31.352585 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:41:31.353033 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:41:10Z,direct_url=,disk_format='qcow2',id=19d144f4-084b-4c62-939d-d67ccdaa4e70,min_disk=0,min_ram=0,name='',owner='9f495a79e34349dcb1930df0038204fa',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:41:13Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:41:31.353268 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:41:31.353329 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:41:31.353506 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:41:31.353716 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:41:31.353716 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:41:31.354003 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:41:31.354229 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:41:31.354229 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:41:31.354315 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:41:31.354738 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:41:31.361173 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:41:31.383779 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Successfully updated port: 0030c2aa-ca73-4a59-a23c-2b1e3864d2fb {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:41:31.391483 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:41:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-613777004',display_name='tempest-AttachSCSIVolumeTestJSON-server-613777004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-attachscsivolumetestjson-server-613777004',id=3,image_ref='19d144f4-084b-4c62-939d-d67ccdaa4e70',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/k7W/rtELyUz1iF31cO7RdB38ezlqBtbGQf36FILgd3CDfqTLhbMDKey6+yc4KTSXPFFzyA52GnMjminrBjWhcDoU0ftyPqPHkA6d05HiQr/RvAPH4Jx1yrBqInelmzg==',key_name='tempest-keypair-1598629308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c31b6cf6f5f4fff90914e329442d042',ramdisk_id='',reservation_id='r-h6hb1bk4',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d144f4-084b-4c62-939d-d67ccdaa4e70',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-717482791',owner_user_name='tempest-AttachSCSIVolumeTestJSON-717482791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:41:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='653ba57c4bcc479ea05a45ac7b213b1e',uuid=5e52bd75-8566-4472-8147-99655013bc83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "816a6c6d-d655-46f8-9f8e-7b6bde2e2e50", "address": "fa:16:3e:5d:a0:ff", "network": {"id": "0c192e32-6947-44e6-b8c5-07d6f5f711af", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-940608449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c31b6cf6f5f4fff90914e329442d042", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap816a6c6d-d6", "ovs_interfaceid": "816a6c6d-d655-46f8-9f8e-7b6bde2e2e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:41:31.391737 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Converting VIF {"id": "816a6c6d-d655-46f8-9f8e-7b6bde2e2e50", "address": "fa:16:3e:5d:a0:ff", "network": {"id": "0c192e32-6947-44e6-b8c5-07d6f5f711af", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-940608449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c31b6cf6f5f4fff90914e329442d042", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap816a6c6d-d6", "ovs_interfaceid": "816a6c6d-d655-46f8-9f8e-7b6bde2e2e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:41:31.392578 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:a0:ff,bridge_name='br-int',has_traffic_filtering=True,id=816a6c6d-d655-46f8-9f8e-7b6bde2e2e50,network=Network(0c192e32-6947-44e6-b8c5-07d6f5f711af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap816a6c6d-d6') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:41:31.395917 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:41:31.398762 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Start spawning the instance on the hypervisor. {{(pid=98952) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 25 04:41:31.405834 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Creating instance directory {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 25 04:41:31.407358 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e52bd75-8566-4472-8147-99655013bc83 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:41:31.412478 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Creating image(s) Jun 25 04:41:31.414939 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Found default for hw_cdrom_bus of ide {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:31.416365 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3fade0a-4409-4f45-b07c-7323fbd836bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:31.416677 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Lock "/opt/stack/data/nova/instances/c3fade0a-4409-4f45-b07c-7323fbd836bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:31.417028 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Found default for hw_disk_bus of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:31.418624 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Found default for hw_input_bus of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:31.419401 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Found default for hw_pointer_model of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:31.420506 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Lock "/opt/stack/data/nova/instances/c3fade0a-4409-4f45-b07c-7323fbd836bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.003s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:31.423177 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Found default for hw_video_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:31.424268 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Found default for hw_vif_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:31.429312 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:41:31.441673 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:41:31.441673 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:31.523855 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.083s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:31.525415 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Acquiring lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:31.526016 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:31.527975 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:41:31.532897 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:41:31.533285 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:31.607042 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232, portal: 192.168.40.100,3260] Jun 25 04:41:31.607042 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232, portal: 192.168.40.100,3260] successful. Jun 25 04:41:31.607042 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:41:31.611654 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232, portal: 192.168.50.100,3260] Jun 25 04:41:31.611654 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232, portal: 192.168.50.100,3260] successful. Jun 25 04:41:31.611654 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:41:31.621522 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.088s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:31.622495 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/c3fade0a-4409-4f45-b07c-7323fbd836bb/disk 1073741824 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:31.634749 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:41:31.635631 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:41:31.664031 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:41:31.664031 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:41:31.664031 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:41:31.664223 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:41:31.664223 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:41:31.664223 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:41:31.664981 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.196s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:41:31.665199 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to 192.168.50.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:41:31.666488 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:41:31.666488 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:41:31.666488 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:41:31.666777 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:41:31.666777 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:41:31.666777 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:41:31.669892 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.200s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:41:31.669892 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to 192.168.40.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:41:31.670248 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/c3fade0a-4409-4f45-b07c-7323fbd836bb/disk 1073741824" returned: 0 in 0.048s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:31.670671 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.145s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:31.673152 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:31.687014 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] HCTL ('7', '-', '-', 0) found on session 3 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:41:31.687269 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:41:31.688155 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] HCTL ('8', '-', '-', 0) found on session 4 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:41:31.688300 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:41:31.718383 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching for a device in session 3 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:41:31.718383 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '806b0e55-d716-447a-87d8-208a72ab2232', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:41:31.722645 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching for a device in session 4 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:41:31.722773 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '806b0e55-d716-447a-87d8-208a72ab2232', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:41:31.759818 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.087s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:31.760358 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3fade0a-4409-4f45-b07c-7323fbd836bb/disk. size=1073741824 {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 25 04:41:31.760668 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3fade0a-4409-4f45-b07c-7323fbd836bb/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:31.835471 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:41:31.835703 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:41:31.836261 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:31.836696 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:31.846547 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-6063bb01-2dd5-4d8b-bb84-baed15448c17 req-08a30455-49b7-458c-aa59-5571f86e9c78 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:31.862657 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3fade0a-4409-4f45-b07c-7323fbd836bb/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:31.863171 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Cannot resize image /opt/stack/data/nova/instances/c3fade0a-4409-4f45-b07c-7323fbd836bb/disk to a smaller size. {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 25 04:41:31.863335 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Created local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 25 04:41:31.863513 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Ensure instance console log exists: /opt/stack/data/nova/instances/c3fade0a-4409-4f45-b07c-7323fbd836bb/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:41:31.865015 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:31.865015 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:31.865402 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:31.888498 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Acquiring lock "refresh_cache-c3fade0a-4409-4f45-b07c-7323fbd836bb" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:41:31.888902 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Acquired lock "refresh_cache-c3fade0a-4409-4f45-b07c-7323fbd836bb" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:41:31.889140 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:41:31.906237 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] During sync_power_state the instance has a pending task (spawning). Skip. Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] End _get_guest_xml xml= Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: 5e52bd75-8566-4472-8147-99655013bc83 Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: instance-00000003 Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: 196608 Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: tempest-AttachSCSIVolumeTestJSON-server-613777004 Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: 2026-06-25 04:41:31 Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: 192 Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: 0 Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: 0 Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: True Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: bare Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: 0 Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: scsi Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: scsi Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: virtio-scsi Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: tempest-AttachSCSIVolumeTestJSON-717482791-project-member Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: tempest-AttachSCSIVolumeTestJSON-717482791 Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: 5e52bd75-8566-4472-8147-99655013bc83 Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: 5e52bd75-8566-4472-8147-99655013bc83 Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: hvm Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: 128 Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]:
Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]:
Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: Jun 25 04:41:31.915080 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:41:31.917698 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Preparing to wait for external event network-vif-plugged-816a6c6d-d655-46f8-9f8e-7b6bde2e2e50 {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:41:31.917698 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Acquiring lock "5e52bd75-8566-4472-8147-99655013bc83-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:31.917698 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "5e52bd75-8566-4472-8147-99655013bc83-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:31.917698 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "5e52bd75-8566-4472-8147-99655013bc83-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:31.917698 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:41:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-613777004',display_name='tempest-AttachSCSIVolumeTestJSON-server-613777004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-attachscsivolumetestjson-server-613777004',id=3,image_ref='19d144f4-084b-4c62-939d-d67ccdaa4e70',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/k7W/rtELyUz1iF31cO7RdB38ezlqBtbGQf36FILgd3CDfqTLhbMDKey6+yc4KTSXPFFzyA52GnMjminrBjWhcDoU0ftyPqPHkA6d05HiQr/RvAPH4Jx1yrBqInelmzg==',key_name='tempest-keypair-1598629308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c31b6cf6f5f4fff90914e329442d042',ramdisk_id='',reservation_id='r-h6hb1bk4',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d144f4-084b-4c62-939d-d67ccdaa4e70',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-717482791',owner_user_name='tempest-AttachSCSIVolumeTestJSON-717482791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:41:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='653ba57c4bcc479ea05a45ac7b213b1e',uuid=5e52bd75-8566-4472-8147-99655013bc83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "816a6c6d-d655-46f8-9f8e-7b6bde2e2e50", "address": "fa:16:3e:5d:a0:ff", "network": {"id": "0c192e32-6947-44e6-b8c5-07d6f5f711af", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-940608449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c31b6cf6f5f4fff90914e329442d042", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap816a6c6d-d6", "ovs_interfaceid": "816a6c6d-d655-46f8-9f8e-7b6bde2e2e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:41:31.918178 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Converting VIF {"id": "816a6c6d-d655-46f8-9f8e-7b6bde2e2e50", "address": "fa:16:3e:5d:a0:ff", "network": {"id": "0c192e32-6947-44e6-b8c5-07d6f5f711af", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-940608449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c31b6cf6f5f4fff90914e329442d042", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap816a6c6d-d6", "ovs_interfaceid": "816a6c6d-d655-46f8-9f8e-7b6bde2e2e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:41:31.918178 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:a0:ff,bridge_name='br-int',has_traffic_filtering=True,id=816a6c6d-d655-46f8-9f8e-7b6bde2e2e50,network=Network(0c192e32-6947-44e6-b8c5-07d6f5f711af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap816a6c6d-d6') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:41:31.920354 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:a0:ff,bridge_name='br-int',has_traffic_filtering=True,id=816a6c6d-d655-46f8-9f8e-7b6bde2e2e50,network=Network(0c192e32-6947-44e6-b8c5-07d6f5f711af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap816a6c6d-d6') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:41:31.920354 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:31.920354 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:31.923682 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:41:31.924619 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:31.924846 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '77ae97af-942e-5a61-8a1a-da32cb37bd9f', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:31.926002 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:31.926702 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:41:31.927605 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:31.933699 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:31.933970 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap816a6c6d-d6, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:31.934387 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap816a6c6d-d6, col_values=(('qos', UUID('eee0b3e1-b0f8-4d46-b1a8-8fcfc3467a27')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:31.934540 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap816a6c6d-d6, col_values=(('external_ids', {'iface-id': '816a6c6d-d655-46f8-9f8e-7b6bde2e2e50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:a0:ff', 'vm-uuid': '5e52bd75-8566-4472-8147-99655013bc83'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:31.935970 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:31.938080 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:41:31.942392 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Took 21.61 seconds to spawn the instance on the hypervisor. Jun 25 04:41:31.942508 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:41:31.944924 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:31.945761 np0000003587 nova-compute[98952]: INFO os_vif [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:a0:ff,bridge_name='br-int',has_traffic_filtering=True,id=816a6c6d-d655-46f8-9f8e-7b6bde2e2e50,network=Network(0c192e32-6947-44e6-b8c5-07d6f5f711af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap816a6c6d-d6') Jun 25 04:41:32.035547 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '179040074a1049d9bc174be848d7d9c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb74c8d593e41439c11018567cee50e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:41:32.160651 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-4966bd3c-fd7c-459d-9da1-d6875497da56 req-f5e52662-b357-4930-b182-489df8e2b212 service nova] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Received event network-changed-0030c2aa-ca73-4a59-a23c-2b1e3864d2fb {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:41:32.160651 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-4966bd3c-fd7c-459d-9da1-d6875497da56 req-f5e52662-b357-4930-b182-489df8e2b212 service nova] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Refreshing instance network info cache due to event network-changed-0030c2aa-ca73-4a59-a23c-2b1e3864d2fb. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:41:32.160845 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4966bd3c-fd7c-459d-9da1-d6875497da56 req-f5e52662-b357-4930-b182-489df8e2b212 service nova] Acquiring lock "refresh_cache-c3fade0a-4409-4f45-b07c-7323fbd836bb" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:41:32.290288 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-6063bb01-2dd5-4d8b-bb84-baed15448c17 req-08a30455-49b7-458c-aa59-5571f86e9c78 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:32.335744 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 25 04:41:32.466773 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-6063bb01-2dd5-4d8b-bb84-baed15448c17 req-08a30455-49b7-458c-aa59-5571f86e9c78 service nova] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Updated VIF entry in instance network info cache for port 816a6c6d-d655-46f8-9f8e-7b6bde2e2e50. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:41:32.466773 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-6063bb01-2dd5-4d8b-bb84-baed15448c17 req-08a30455-49b7-458c-aa59-5571f86e9c78 service nova] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Updating instance_info_cache with network_info: [{"id": "816a6c6d-d655-46f8-9f8e-7b6bde2e2e50", "address": "fa:16:3e:5d:a0:ff", "network": {"id": "0c192e32-6947-44e6-b8c5-07d6f5f711af", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-940608449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c31b6cf6f5f4fff90914e329442d042", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap816a6c6d-d6", "ovs_interfaceid": "816a6c6d-d655-46f8-9f8e-7b6bde2e2e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:41:32.470576 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 25 04:41:32.470576 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Took 26.96 seconds to build instance. Jun 25 04:41:32.549585 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:41:32.603441 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Successfully created port: 0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0 {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:41:32.625808 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-a251a774-5f1b-4a85-bcb2-f17bba0eb62c req-935ba7d2-34da-4ab8-a6e3-61ee9e04ace0 service nova] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Received event network-vif-unplugged-5c0f7808-e34f-40a7-8f2d-38eace20dd0a {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:41:32.626724 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a251a774-5f1b-4a85-bcb2-f17bba0eb62c req-935ba7d2-34da-4ab8-a6e3-61ee9e04ace0 service nova] Acquiring lock "9333a704-82ad-4b54-8456-59eb035a2512-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:32.626724 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a251a774-5f1b-4a85-bcb2-f17bba0eb62c req-935ba7d2-34da-4ab8-a6e3-61ee9e04ace0 service nova] Lock "9333a704-82ad-4b54-8456-59eb035a2512-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:32.626724 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a251a774-5f1b-4a85-bcb2-f17bba0eb62c req-935ba7d2-34da-4ab8-a6e3-61ee9e04ace0 service nova] Lock "9333a704-82ad-4b54-8456-59eb035a2512-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:32.626724 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-a251a774-5f1b-4a85-bcb2-f17bba0eb62c req-935ba7d2-34da-4ab8-a6e3-61ee9e04ace0 service nova] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] No waiting events found dispatching network-vif-unplugged-5c0f7808-e34f-40a7-8f2d-38eace20dd0a {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:41:32.626724 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-a251a774-5f1b-4a85-bcb2-f17bba0eb62c req-935ba7d2-34da-4ab8-a6e3-61ee9e04ace0 service nova] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Received unexpected event network-vif-unplugged-5c0f7808-e34f-40a7-8f2d-38eace20dd0a for instance with vm_state building and task_state spawning. Jun 25 04:41:32.795778 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:32.838472 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Start building block device mappings for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 25 04:41:32.932372 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-5679de03-a4a5-44ca-b70d-461e55f7326b req-dc2e4e13-05f9-4e59-9d35-3d10f8e10dd5 service nova] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Received event network-vif-plugged-16a2d9c6-253c-4ce0-84cf-2bfd90c87576 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:41:32.932593 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-5679de03-a4a5-44ca-b70d-461e55f7326b req-dc2e4e13-05f9-4e59-9d35-3d10f8e10dd5 service nova] Acquiring lock "11145d6a-7a4f-4b00-8543-d9b51514d9de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:32.932766 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-5679de03-a4a5-44ca-b70d-461e55f7326b req-dc2e4e13-05f9-4e59-9d35-3d10f8e10dd5 service nova] Lock "11145d6a-7a4f-4b00-8543-d9b51514d9de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:32.932893 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-5679de03-a4a5-44ca-b70d-461e55f7326b req-dc2e4e13-05f9-4e59-9d35-3d10f8e10dd5 service nova] Lock "11145d6a-7a4f-4b00-8543-d9b51514d9de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:32.932990 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-5679de03-a4a5-44ca-b70d-461e55f7326b req-dc2e4e13-05f9-4e59-9d35-3d10f8e10dd5 service nova] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] No waiting events found dispatching network-vif-plugged-16a2d9c6-253c-4ce0-84cf-2bfd90c87576 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:41:32.933096 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-5679de03-a4a5-44ca-b70d-461e55f7326b req-dc2e4e13-05f9-4e59-9d35-3d10f8e10dd5 service nova] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Received unexpected event network-vif-plugged-16a2d9c6-253c-4ce0-84cf-2bfd90c87576 for instance with vm_state active and task_state None. Jun 25 04:41:32.933245 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-5679de03-a4a5-44ca-b70d-461e55f7326b req-dc2e4e13-05f9-4e59-9d35-3d10f8e10dd5 service nova] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Received event network-vif-unplugged-0030c2aa-ca73-4a59-a23c-2b1e3864d2fb {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:41:32.937029 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-5679de03-a4a5-44ca-b70d-461e55f7326b req-dc2e4e13-05f9-4e59-9d35-3d10f8e10dd5 service nova] Acquiring lock "c3fade0a-4409-4f45-b07c-7323fbd836bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:32.937172 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-5679de03-a4a5-44ca-b70d-461e55f7326b req-dc2e4e13-05f9-4e59-9d35-3d10f8e10dd5 service nova] Lock "c3fade0a-4409-4f45-b07c-7323fbd836bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:32.937350 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-5679de03-a4a5-44ca-b70d-461e55f7326b req-dc2e4e13-05f9-4e59-9d35-3d10f8e10dd5 service nova] Lock "c3fade0a-4409-4f45-b07c-7323fbd836bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:32.937432 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-5679de03-a4a5-44ca-b70d-461e55f7326b req-dc2e4e13-05f9-4e59-9d35-3d10f8e10dd5 service nova] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] No waiting events found dispatching network-vif-unplugged-0030c2aa-ca73-4a59-a23c-2b1e3864d2fb {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:41:32.937577 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-5679de03-a4a5-44ca-b70d-461e55f7326b req-dc2e4e13-05f9-4e59-9d35-3d10f8e10dd5 service nova] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Received unexpected event network-vif-unplugged-0030c2aa-ca73-4a59-a23c-2b1e3864d2fb for instance with vm_state building and task_state spawning. Jun 25 04:41:32.940963 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Updating instance_info_cache with network_info: [{"id": "0030c2aa-ca73-4a59-a23c-2b1e3864d2fb", "address": "fa:16:3e:aa:1a:04", "network": {"id": "e6d1e426-4d58-4466-8f0e-ff171a5896ad", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521310257-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9cb9320b8eea43c5a20e2a3fcfb2c3dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0030c2aa-ca", "ovs_interfaceid": "0030c2aa-ca73-4a59-a23c-2b1e3864d2fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:41:32.971545 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6063bb01-2dd5-4d8b-bb84-baed15448c17 req-08a30455-49b7-458c-aa59-5571f86e9c78 service nova] Releasing lock "refresh_cache-5e52bd75-8566-4472-8147-99655013bc83" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:41:32.972540 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-44a4c7fd-394c-44e0-a185-625cc653e038 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "11145d6a-7a4f-4b00-8543-d9b51514d9de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 28.473s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:33.227601 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Successfully updated port: 0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0 {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:41:33.443772 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Releasing lock "refresh_cache-c3fade0a-4409-4f45-b07c-7323fbd836bb" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:41:33.444250 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Instance network_info: |[{"id": "0030c2aa-ca73-4a59-a23c-2b1e3864d2fb", "address": "fa:16:3e:aa:1a:04", "network": {"id": "e6d1e426-4d58-4466-8f0e-ff171a5896ad", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521310257-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9cb9320b8eea43c5a20e2a3fcfb2c3dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0030c2aa-ca", "ovs_interfaceid": "0030c2aa-ca73-4a59-a23c-2b1e3864d2fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 25 04:41:33.445146 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4966bd3c-fd7c-459d-9da1-d6875497da56 req-f5e52662-b357-4930-b182-489df8e2b212 service nova] Acquired lock "refresh_cache-c3fade0a-4409-4f45-b07c-7323fbd836bb" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:41:33.446241 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-4966bd3c-fd7c-459d-9da1-d6875497da56 req-f5e52662-b357-4930-b182-489df8e2b212 service nova] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Refreshing network info cache for port 0030c2aa-ca73-4a59-a23c-2b1e3864d2fb {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:41:33.448579 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Start _get_guest_xml network_info=[{"id": "0030c2aa-ca73-4a59-a23c-2b1e3864d2fb", "address": "fa:16:3e:aa:1a:04", "network": {"id": "e6d1e426-4d58-4466-8f0e-ff171a5896ad", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521310257-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9cb9320b8eea43c5a20e2a3fcfb2c3dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0030c2aa-ca", "ovs_interfaceid": "0030c2aa-ca73-4a59-a23c-2b1e3864d2fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '4ecaf199-c1b9-4ce3-869c-178c170c1662'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:41:33.451633 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:41:33.453136 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='tempest-VolumesAdminNegativeTest-server-782605093', uuid='c3fade0a-4409-4f45-b07c-7323fbd836bb'), owner=OwnerMeta(userid='950b42e61fcf44b5bf32db2678cf1907', username='tempest-VolumesAdminNegativeTest-2037926086-project-member', projectid='9cb9320b8eea43c5a20e2a3fcfb2c3dc', projectname='tempest-VolumesAdminNegativeTest-2037926086'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0030c2aa-ca73-4a59-a23c-2b1e3864d2fb", "address": "fa:16:3e:aa:1a:04", "network": {"id": "e6d1e426-4d58-4466-8f0e-ff171a5896ad", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521310257-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9cb9320b8eea43c5a20e2a3fcfb2c3dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0030c2aa-ca", "ovs_interfaceid": "0030c2aa-ca73-4a59-a23c-2b1e3864d2fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362493.4526463) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:41:33.454628 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:41:33.455134 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:41:33.457075 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:41:33.457288 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:41:33.458248 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:41:33.458589 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:41:33.458735 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:41:33.458833 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:41:33.458964 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:41:33.459049 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:41:33.459142 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:41:33.459291 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:41:33.459387 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:41:33.459492 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:41:33.460112 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:41:33.460264 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:41:33.472908 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:41:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-782605093',display_name='tempest-VolumesAdminNegativeTest-server-782605093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-volumesadminnegativetest-server-782605093',id=4,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cb9320b8eea43c5a20e2a3fcfb2c3dc',ramdisk_id='',reservation_id='r-w0s5uazx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2037926086',owner_user_name='tempest-VolumesAdminNegativeTest-2037926086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:41:30Z,user_data=None,user_id='950b42e61fcf44b5bf32db2678cf1907',uuid=c3fade0a-4409-4f45-b07c-7323fbd836bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0030c2aa-ca73-4a59-a23c-2b1e3864d2fb", "address": "fa:16:3e:aa:1a:04", "network": {"id": "e6d1e426-4d58-4466-8f0e-ff171a5896ad", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521310257-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9cb9320b8eea43c5a20e2a3fcfb2c3dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0030c2aa-ca", "ovs_interfaceid": "0030c2aa-ca73-4a59-a23c-2b1e3864d2fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:41:33.473154 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Converting VIF {"id": "0030c2aa-ca73-4a59-a23c-2b1e3864d2fb", "address": "fa:16:3e:aa:1a:04", "network": {"id": "e6d1e426-4d58-4466-8f0e-ff171a5896ad", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521310257-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9cb9320b8eea43c5a20e2a3fcfb2c3dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0030c2aa-ca", "ovs_interfaceid": "0030c2aa-ca73-4a59-a23c-2b1e3864d2fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:41:33.473757 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:1a:04,bridge_name='br-int',has_traffic_filtering=True,id=0030c2aa-ca73-4a59-a23c-2b1e3864d2fb,network=Network(e6d1e426-4d58-4466-8f0e-ff171a5896ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0030c2aa-ca') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:41:33.474217 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Lazy-loading 'pci_devices' on Instance uuid c3fade0a-4409-4f45-b07c-7323fbd836bb {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:41:33.483547 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] No BDM found with device name sda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:41:33.484211 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:41:33.484211 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] No VIF found with MAC fa:16:3e:5d:a0:ff, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:41:33.484798 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Using config drive Jun 25 04:41:33.486639 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Found WWN 3300000002902f093 for multipath device dm-0 {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 25 04:41:33.487001 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.040s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:41:33.487202 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] <== connect_volume: return (4040ms) {'type': 'block', 'scsi_wwn': '3300000002902f093', 'path': '/dev/dm-0', 'multipath_id': '3300000002902f093'} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:41:33.487360 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002902f093', 'path': '/dev/dm-0', 'multipath_id': '3300000002902f093'} {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 25 04:41:33.729578 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Acquiring lock "refresh_cache-54721bc9-c45c-4cb1-9910-f47334e84cd2" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:41:33.730240 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Acquired lock "refresh_cache-54721bc9-c45c-4cb1-9910-f47334e84cd2" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:41:33.730361 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:41:33.848740 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Start spawning the instance on the hypervisor. {{(pid=98952) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 25 04:41:33.850534 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Creating instance directory {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 25 04:41:33.850534 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Creating image(s) Jun 25 04:41:33.851300 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Acquiring lock "/opt/stack/data/nova/instances/54721bc9-c45c-4cb1-9910-f47334e84cd2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:33.851300 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Lock "/opt/stack/data/nova/instances/54721bc9-c45c-4cb1-9910-f47334e84cd2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:33.851655 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Lock "/opt/stack/data/nova/instances/54721bc9-c45c-4cb1-9910-f47334e84cd2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:33.852209 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:41:33.856387 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:41:33.873623 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:33.924330 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:33.946411 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.073s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:33.947232 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Acquiring lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:33.947729 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:33.948238 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:41:33.951925 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:41:33.954348 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:33.955696 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-4966bd3c-fd7c-459d-9da1-d6875497da56 req-f5e52662-b357-4930-b182-489df8e2b212 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] End _get_guest_xml xml= Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: c3fade0a-4409-4f45-b07c-7323fbd836bb Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: instance-00000004 Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: 196608 Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: tempest-VolumesAdminNegativeTest-server-782605093 Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: 2026-06-25 04:41:33 Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: 192 Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: 0 Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: 0 Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: True Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: bare Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: 0 Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: virtio Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: tempest-VolumesAdminNegativeTest-2037926086-project-member Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: tempest-VolumesAdminNegativeTest-2037926086 Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: c3fade0a-4409-4f45-b07c-7323fbd836bb Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: c3fade0a-4409-4f45-b07c-7323fbd836bb Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: hvm Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: 128 Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: Jun 25 04:41:33.985008 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:41:33.987897 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Preparing to wait for external event network-vif-plugged-0030c2aa-ca73-4a59-a23c-2b1e3864d2fb {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:41:33.987897 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Acquiring lock "c3fade0a-4409-4f45-b07c-7323fbd836bb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:33.987897 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Lock "c3fade0a-4409-4f45-b07c-7323fbd836bb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:33.987897 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Lock "c3fade0a-4409-4f45-b07c-7323fbd836bb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:33.987897 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:41:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-782605093',display_name='tempest-VolumesAdminNegativeTest-server-782605093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-volumesadminnegativetest-server-782605093',id=4,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cb9320b8eea43c5a20e2a3fcfb2c3dc',ramdisk_id='',reservation_id='r-w0s5uazx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2037926086',owner_user_name='tempest-VolumesAdminNegativeTest-2037926086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:41:30Z,user_data=None,user_id='950b42e61fcf44b5bf32db2678cf1907',uuid=c3fade0a-4409-4f45-b07c-7323fbd836bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0030c2aa-ca73-4a59-a23c-2b1e3864d2fb", "address": "fa:16:3e:aa:1a:04", "network": {"id": "e6d1e426-4d58-4466-8f0e-ff171a5896ad", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521310257-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9cb9320b8eea43c5a20e2a3fcfb2c3dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0030c2aa-ca", "ovs_interfaceid": "0030c2aa-ca73-4a59-a23c-2b1e3864d2fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:41:33.988178 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Converting VIF {"id": "0030c2aa-ca73-4a59-a23c-2b1e3864d2fb", "address": "fa:16:3e:aa:1a:04", "network": {"id": "e6d1e426-4d58-4466-8f0e-ff171a5896ad", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521310257-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9cb9320b8eea43c5a20e2a3fcfb2c3dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0030c2aa-ca", "ovs_interfaceid": "0030c2aa-ca73-4a59-a23c-2b1e3864d2fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:41:33.989258 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:1a:04,bridge_name='br-int',has_traffic_filtering=True,id=0030c2aa-ca73-4a59-a23c-2b1e3864d2fb,network=Network(e6d1e426-4d58-4466-8f0e-ff171a5896ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0030c2aa-ca') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:41:33.989930 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:1a:04,bridge_name='br-int',has_traffic_filtering=True,id=0030c2aa-ca73-4a59-a23c-2b1e3864d2fb,network=Network(e6d1e426-4d58-4466-8f0e-ff171a5896ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0030c2aa-ca') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:41:33.997538 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:34.001979 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:41:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-16129467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-attachvolumemultiattachtest-server-16129467',id=2,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='284d191aa82f453cabcfd18172f74099',ramdisk_id='',reservation_id='r-l6o403w6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1256899935',owner_user_name='tempest-AttachVolumeMultiAttachTest-1256899935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:41:25Z,user_data=None,user_id='947bde0e827c45f5bab008d094816d8c',uuid=9333a704-82ad-4b54-8456-59eb035a2512,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c0f7808-e34f-40a7-8f2d-38eace20dd0a", "address": "fa:16:3e:78:7a:c8", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c0f7808-e3", "ovs_interfaceid": "5c0f7808-e34f-40a7-8f2d-38eace20dd0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:41:34.001979 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converting VIF {"id": "5c0f7808-e34f-40a7-8f2d-38eace20dd0a", "address": "fa:16:3e:78:7a:c8", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c0f7808-e3", "ovs_interfaceid": "5c0f7808-e34f-40a7-8f2d-38eace20dd0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:41:34.002285 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:7a:c8,bridge_name='br-int',has_traffic_filtering=True,id=5c0f7808-e34f-40a7-8f2d-38eace20dd0a,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c0f7808-e3') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:41:34.005978 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lazy-loading 'pci_devices' on Instance uuid 9333a704-82ad-4b54-8456-59eb035a2512 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:41:34.012320 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:34.013245 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:34.013245 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:41:34.016725 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:34.016725 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aed03615-92d8-5fad-b9a4-ab0c50321021', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:34.016725 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:34.017084 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:41:34.023959 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:34.032608 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:34.032608 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0030c2aa-ca, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:34.032608 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0030c2aa-ca, col_values=(('qos', UUID('567e73ff-4a42-498f-94c9-80f403782e17')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:34.032608 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0030c2aa-ca, col_values=(('external_ids', {'iface-id': '0030c2aa-ca73-4a59-a23c-2b1e3864d2fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:1a:04', 'vm-uuid': 'c3fade0a-4409-4f45-b07c-7323fbd836bb'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:34.037997 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:41:34.039005 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.085s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:34.039432 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/54721bc9-c45c-4cb1-9910-f47334e84cd2/disk 1073741824 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:34.047913 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:34.054355 np0000003587 nova-compute[98952]: INFO os_vif [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:1a:04,bridge_name='br-int',has_traffic_filtering=True,id=0030c2aa-ca73-4a59-a23c-2b1e3864d2fb,network=Network(e6d1e426-4d58-4466-8f0e-ff171a5896ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0030c2aa-ca') Jun 25 04:41:34.088029 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/54721bc9-c45c-4cb1-9910-f47334e84cd2/disk 1073741824" returned: 0 in 0.048s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:34.089173 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.141s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:34.089532 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:34.175313 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.085s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:34.175759 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Checking if we can resize image /opt/stack/data/nova/instances/54721bc9-c45c-4cb1-9910-f47334e84cd2/disk. size=1073741824 {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 25 04:41:34.175999 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54721bc9-c45c-4cb1-9910-f47334e84cd2/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:34.241358 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Creating config drive at /opt/stack/data/nova/instances/5e52bd75-8566-4472-8147-99655013bc83/disk.config Jun 25 04:41:34.247232 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5e52bd75-8566-4472-8147-99655013bc83/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp836hz35m {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:34.268281 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54721bc9-c45c-4cb1-9910-f47334e84cd2/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:34.270614 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-71440e38-8767-41ff-8175-1ec3aa51bde5 req-6cacae05-61a7-4ae8-9ca5-d00321c67f87 service nova] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Received event network-changed-0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:41:34.275093 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Cannot resize image /opt/stack/data/nova/instances/54721bc9-c45c-4cb1-9910-f47334e84cd2/disk to a smaller size. {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 25 04:41:34.275631 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-71440e38-8767-41ff-8175-1ec3aa51bde5 req-6cacae05-61a7-4ae8-9ca5-d00321c67f87 service nova] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Refreshing instance network info cache due to event network-changed-0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:41:34.276473 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-71440e38-8767-41ff-8175-1ec3aa51bde5 req-6cacae05-61a7-4ae8-9ca5-d00321c67f87 service nova] Acquiring lock "refresh_cache-54721bc9-c45c-4cb1-9910-f47334e84cd2" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:41:34.276473 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Created local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 25 04:41:34.278194 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Ensure instance console log exists: /opt/stack/data/nova/instances/54721bc9-c45c-4cb1-9910-f47334e84cd2/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:41:34.278194 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:34.278194 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:34.278194 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:34.282577 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5e52bd75-8566-4472-8147-99655013bc83/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp836hz35m" returned: 0 in 0.035s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:34.352367 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:41:34.464058 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-4966bd3c-fd7c-459d-9da1-d6875497da56 req-f5e52662-b357-4930-b182-489df8e2b212 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] End _get_guest_xml xml= Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: 9333a704-82ad-4b54-8456-59eb035a2512 Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: instance-00000002 Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: 196608 Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: tempest-AttachVolumeMultiAttachTest-server-16129467 Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: 2026-06-25 04:41:29 Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: 192 Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: 0 Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: 0 Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: True Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: 0 Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: virtio Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: tempest-AttachVolumeMultiAttachTest-1256899935-project-member Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: tempest-AttachVolumeMultiAttachTest-1256899935 Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: 9333a704-82ad-4b54-8456-59eb035a2512 Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: 9333a704-82ad-4b54-8456-59eb035a2512 Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: hvm Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: 128 Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: 806b0e55-d716-447a-87d8-208a72ab2232 Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: Jun 25 04:41:34.516232 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:41:34.519047 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Preparing to wait for external event network-vif-plugged-5c0f7808-e34f-40a7-8f2d-38eace20dd0a {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:41:34.519047 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "9333a704-82ad-4b54-8456-59eb035a2512-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:34.519047 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "9333a704-82ad-4b54-8456-59eb035a2512-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:34.519047 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "9333a704-82ad-4b54-8456-59eb035a2512-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:34.519047 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:41:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-16129467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-attachvolumemultiattachtest-server-16129467',id=2,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='284d191aa82f453cabcfd18172f74099',ramdisk_id='',reservation_id='r-l6o403w6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1256899935',owner_user_name='tempest-AttachVolumeMultiAttachTest-1256899935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:41:25Z,user_data=None,user_id='947bde0e827c45f5bab008d094816d8c',uuid=9333a704-82ad-4b54-8456-59eb035a2512,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c0f7808-e34f-40a7-8f2d-38eace20dd0a", "address": "fa:16:3e:78:7a:c8", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c0f7808-e3", "ovs_interfaceid": "5c0f7808-e34f-40a7-8f2d-38eace20dd0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:41:34.519306 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converting VIF {"id": "5c0f7808-e34f-40a7-8f2d-38eace20dd0a", "address": "fa:16:3e:78:7a:c8", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c0f7808-e3", "ovs_interfaceid": "5c0f7808-e34f-40a7-8f2d-38eace20dd0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:41:34.522795 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:7a:c8,bridge_name='br-int',has_traffic_filtering=True,id=5c0f7808-e34f-40a7-8f2d-38eace20dd0a,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c0f7808-e3') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:41:34.522795 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:7a:c8,bridge_name='br-int',has_traffic_filtering=True,id=5c0f7808-e34f-40a7-8f2d-38eace20dd0a,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c0f7808-e3') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:41:34.522795 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:34.522795 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:34.522795 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:41:34.522795 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:34.522795 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '989b1c8e-b56e-5a9b-993c-d2c57118a05b', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:34.525890 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:34.527091 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:41:34.540598 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:34.542955 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:34.543257 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c0f7808-e3, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:34.543796 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c0f7808-e3, col_values=(('qos', UUID('a5f445ed-f4ce-44cf-aaee-fdf0b0e6b6ee')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:34.544062 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c0f7808-e3, col_values=(('external_ids', {'iface-id': '5c0f7808-e34f-40a7-8f2d-38eace20dd0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:7a:c8', 'vm-uuid': '9333a704-82ad-4b54-8456-59eb035a2512'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:34.545849 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:34.548053 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:41:34.560045 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:34.564940 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:34.569927 np0000003587 nova-compute[98952]: INFO os_vif [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:7a:c8,bridge_name='br-int',has_traffic_filtering=True,id=5c0f7808-e34f-40a7-8f2d-38eace20dd0a,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c0f7808-e3') Jun 25 04:41:34.652967 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-4966bd3c-fd7c-459d-9da1-d6875497da56 req-f5e52662-b357-4930-b182-489df8e2b212 service nova] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Updated VIF entry in instance network info cache for port 0030c2aa-ca73-4a59-a23c-2b1e3864d2fb. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:41:34.653219 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-4966bd3c-fd7c-459d-9da1-d6875497da56 req-f5e52662-b357-4930-b182-489df8e2b212 service nova] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Updating instance_info_cache with network_info: [{"id": "0030c2aa-ca73-4a59-a23c-2b1e3864d2fb", "address": "fa:16:3e:aa:1a:04", "network": {"id": "e6d1e426-4d58-4466-8f0e-ff171a5896ad", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521310257-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9cb9320b8eea43c5a20e2a3fcfb2c3dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0030c2aa-ca", "ovs_interfaceid": "0030c2aa-ca73-4a59-a23c-2b1e3864d2fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:41:34.747326 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Updating instance_info_cache with network_info: [{"id": "0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0", "address": "fa:16:3e:b0:e8:8f", "network": {"id": "fdf32429-f589-4e76-997e-ddfdb055d2fc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-863894942-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6eb74c8d593e41439c11018567cee50e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6c191b-4d", "ovs_interfaceid": "0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:41:34.786664 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:34.817502 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:34.918958 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:34.940086 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-147275e3-0e44-4eba-8b98-24b70efb8f1b tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:41:35.127013 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:35.143504 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:35.145822 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:35.157440 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4966bd3c-fd7c-459d-9da1-d6875497da56 req-f5e52662-b357-4930-b182-489df8e2b212 service nova] Releasing lock "refresh_cache-c3fade0a-4409-4f45-b07c-7323fbd836bb" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:41:35.173062 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:35.187000 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:35.249394 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Releasing lock "refresh_cache-54721bc9-c45c-4cb1-9910-f47334e84cd2" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:41:35.249822 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Instance network_info: |[{"id": "0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0", "address": "fa:16:3e:b0:e8:8f", "network": {"id": "fdf32429-f589-4e76-997e-ddfdb055d2fc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-863894942-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6eb74c8d593e41439c11018567cee50e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6c191b-4d", "ovs_interfaceid": "0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 25 04:41:35.254279 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Start _get_guest_xml network_info=[{"id": "0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0", "address": "fa:16:3e:b0:e8:8f", "network": {"id": "fdf32429-f589-4e76-997e-ddfdb055d2fc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-863894942-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6eb74c8d593e41439c11018567cee50e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6c191b-4d", "ovs_interfaceid": "0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '4ecaf199-c1b9-4ce3-869c-178c170c1662'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:41:35.254613 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-71440e38-8767-41ff-8175-1ec3aa51bde5 req-6cacae05-61a7-4ae8-9ca5-d00321c67f87 service nova] Acquired lock "refresh_cache-54721bc9-c45c-4cb1-9910-f47334e84cd2" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:41:35.254937 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-71440e38-8767-41ff-8175-1ec3aa51bde5 req-6cacae05-61a7-4ae8-9ca5-d00321c67f87 service nova] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Refreshing network info cache for port 0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:41:35.258166 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:41:35.259961 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='tempest-VolumesAssistedSnapshotsTest-server-1227199569', uuid='54721bc9-c45c-4cb1-9910-f47334e84cd2'), owner=OwnerMeta(userid='179040074a1049d9bc174be848d7d9c0', username='tempest-VolumesAssistedSnapshotsTest-382681988-project-member', projectid='6eb74c8d593e41439c11018567cee50e', projectname='tempest-VolumesAssistedSnapshotsTest-382681988'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0", "address": "fa:16:3e:b0:e8:8f", "network": {"id": "fdf32429-f589-4e76-997e-ddfdb055d2fc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-863894942-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6eb74c8d593e41439c11018567cee50e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6c191b-4d", "ovs_interfaceid": "0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362495.2593696) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:41:35.268785 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:41:35.269212 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:41:35.274734 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:41:35.274919 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:41:35.276216 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:41:35.276749 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:41:35.277878 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:41:35.278056 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:41:35.278243 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:41:35.278377 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:41:35.278511 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:41:35.278749 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:41:35.279168 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:41:35.279168 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:41:35.279247 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:41:35.279392 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:41:35.301054 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1227199569',display_name='tempest-VolumesAssistedSnapshotsTest-server-1227199569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-volumesassistedsnapshotstest-server-1227199569',id=5,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbIZAFVua5mBPvMJOilRXmBvLsyInZ+SWc61AFvIErIYKRe5Z87o2zKqzduRk6h553mssYTF0MlLORTw6cOhK1B33hhsDc52xx3z+75MCTk5ugCM+y+8KBeiBg0Zgm4+A==',key_name='tempest-keypair-360538157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6eb74c8d593e41439c11018567cee50e',ramdisk_id='',reservation_id='r-gr10d9pc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-382681988',owner_user_name='tempest-VolumesAssistedSnapshotsTest-382681988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:41:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='179040074a1049d9bc174be848d7d9c0',uuid=54721bc9-c45c-4cb1-9910-f47334e84cd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0", "address": "fa:16:3e:b0:e8:8f", "network": {"id": "fdf32429-f589-4e76-997e-ddfdb055d2fc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-863894942-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6eb74c8d593e41439c11018567cee50e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6c191b-4d", "ovs_interfaceid": "0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:41:35.302046 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Converting VIF {"id": "0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0", "address": "fa:16:3e:b0:e8:8f", "network": {"id": "fdf32429-f589-4e76-997e-ddfdb055d2fc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-863894942-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6eb74c8d593e41439c11018567cee50e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6c191b-4d", "ovs_interfaceid": "0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:41:35.302781 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:e8:8f,bridge_name='br-int',has_traffic_filtering=True,id=0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0,network=Network(fdf32429-f589-4e76-997e-ddfdb055d2fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6c191b-4d') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:41:35.303693 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Lazy-loading 'pci_devices' on Instance uuid 54721bc9-c45c-4cb1-9910-f47334e84cd2 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:41:35.360032 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8b7eed26-68d8-42ff-8c03-102c531a788d req-42af0b17-d563-4575-96bf-e2533d355da2 service nova] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Received event network-vif-plugged-816a6c6d-d655-46f8-9f8e-7b6bde2e2e50 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:41:35.361185 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8b7eed26-68d8-42ff-8c03-102c531a788d req-42af0b17-d563-4575-96bf-e2533d355da2 service nova] Acquiring lock "5e52bd75-8566-4472-8147-99655013bc83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:35.361185 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8b7eed26-68d8-42ff-8c03-102c531a788d req-42af0b17-d563-4575-96bf-e2533d355da2 service nova] Lock "5e52bd75-8566-4472-8147-99655013bc83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:35.361293 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8b7eed26-68d8-42ff-8c03-102c531a788d req-42af0b17-d563-4575-96bf-e2533d355da2 service nova] Lock "5e52bd75-8566-4472-8147-99655013bc83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:35.361350 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8b7eed26-68d8-42ff-8c03-102c531a788d req-42af0b17-d563-4575-96bf-e2533d355da2 service nova] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Processing event network-vif-plugged-816a6c6d-d655-46f8-9f8e-7b6bde2e2e50 {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:41:35.453026 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-147275e3-0e44-4eba-8b98-24b70efb8f1b tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] instance snapshotting Jun 25 04:41:35.594061 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-147275e3-0e44-4eba-8b98-24b70efb8f1b tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Beginning live snapshot process Jun 25 04:41:35.598387 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:41:35.598387 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:41:35.598387 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] No VIF found with MAC fa:16:3e:aa:1a:04, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:41:35.601534 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Using config drive Jun 25 04:41:35.756241 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:41:35.756415 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 5e52bd75-8566-4472-8147-99655013bc83] VM Started (Lifecycle Event) Jun 25 04:41:35.757723 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:41:35.761200 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Guest created on hypervisor {{(pid=98952) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 25 04:41:35.761931 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-71440e38-8767-41ff-8175-1ec3aa51bde5 req-6cacae05-61a7-4ae8-9ca5-d00321c67f87 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:35.765601 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Instance spawned successfully. Jun 25 04:41:35.766273 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 25 04:41:35.770680 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Found default for hw_input_bus of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:35.770680 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Found default for hw_pointer_model of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:35.770680 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Found default for hw_video_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:35.770680 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Found default for hw_vif_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] End _get_guest_xml xml= Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: 54721bc9-c45c-4cb1-9910-f47334e84cd2 Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: instance-00000005 Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: 196608 Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: tempest-VolumesAssistedSnapshotsTest-server-1227199569 Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: 2026-06-25 04:41:35 Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: 192 Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: 0 Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: 0 Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: True Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: bare Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: 0 Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: virtio Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: tempest-VolumesAssistedSnapshotsTest-382681988-project-member Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: tempest-VolumesAssistedSnapshotsTest-382681988 Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: 54721bc9-c45c-4cb1-9910-f47334e84cd2 Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: 54721bc9-c45c-4cb1-9910-f47334e84cd2 Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: hvm Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: 128 Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:41:35.807137 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Preparing to wait for external event network-vif-plugged-0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0 {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:41:35.809468 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Acquiring lock "54721bc9-c45c-4cb1-9910-f47334e84cd2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:35.809468 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Lock "54721bc9-c45c-4cb1-9910-f47334e84cd2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:35.809468 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Lock "54721bc9-c45c-4cb1-9910-f47334e84cd2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:35.809468 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1227199569',display_name='tempest-VolumesAssistedSnapshotsTest-server-1227199569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-volumesassistedsnapshotstest-server-1227199569',id=5,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbIZAFVua5mBPvMJOilRXmBvLsyInZ+SWc61AFvIErIYKRe5Z87o2zKqzduRk6h553mssYTF0MlLORTw6cOhK1B33hhsDc52xx3z+75MCTk5ugCM+y+8KBeiBg0Zgm4+A==',key_name='tempest-keypair-360538157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6eb74c8d593e41439c11018567cee50e',ramdisk_id='',reservation_id='r-gr10d9pc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-382681988',owner_user_name='tempest-VolumesAssistedSnapshotsTest-382681988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:41:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='179040074a1049d9bc174be848d7d9c0',uuid=54721bc9-c45c-4cb1-9910-f47334e84cd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0", "address": "fa:16:3e:b0:e8:8f", "network": {"id": "fdf32429-f589-4e76-997e-ddfdb055d2fc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-863894942-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6eb74c8d593e41439c11018567cee50e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6c191b-4d", "ovs_interfaceid": "0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:41:35.809756 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Converting VIF {"id": "0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0", "address": "fa:16:3e:b0:e8:8f", "network": {"id": "fdf32429-f589-4e76-997e-ddfdb055d2fc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-863894942-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6eb74c8d593e41439c11018567cee50e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6c191b-4d", "ovs_interfaceid": "0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:41:35.809756 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:e8:8f,bridge_name='br-int',has_traffic_filtering=True,id=0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0,network=Network(fdf32429-f589-4e76-997e-ddfdb055d2fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6c191b-4d') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:41:35.809756 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:e8:8f,bridge_name='br-int',has_traffic_filtering=True,id=0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0,network=Network(fdf32429-f589-4e76-997e-ddfdb055d2fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6c191b-4d') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:41:35.810185 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:35.810382 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:35.810565 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:41:35.812300 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:35.812469 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a9488f42-8d39-5e33-85d5-313621eb7a7a', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:35.815205 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:35.815837 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:41:35.826411 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:35.830844 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:35.830990 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a6c191b-4d, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:35.831385 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a6c191b-4d, col_values=(('qos', UUID('42f4ec77-a437-4cfd-b984-265a425e9499')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:35.831614 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a6c191b-4d, col_values=(('external_ids', {'iface-id': '0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:e8:8f', 'vm-uuid': '54721bc9-c45c-4cb1-9910-f47334e84cd2'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:35.834964 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:35.836832 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:41:35.853132 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:35.854402 np0000003587 nova-compute[98952]: INFO os_vif [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:e8:8f,bridge_name='br-int',has_traffic_filtering=True,id=0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0,network=Network(fdf32429-f589-4e76-997e-ddfdb055d2fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6c191b-4d') Jun 25 04:41:36.102531 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:41:36.102725 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:41:36.102802 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No VIF found with MAC fa:16:3e:78:7a:c8, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:41:36.103163 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Using config drive Jun 25 04:41:36.112034 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:36.211315 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-71440e38-8767-41ff-8175-1ec3aa51bde5 req-6cacae05-61a7-4ae8-9ca5-d00321c67f87 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:36.265971 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:41:36.269238 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:41:36.276204 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Took 7.35 seconds to spawn the instance on the hypervisor. Jun 25 04:41:36.276388 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:41:36.385133 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Creating config drive at /opt/stack/data/nova/instances/c3fade0a-4409-4f45-b07c-7323fbd836bb/disk.config Jun 25 04:41:36.391261 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c3fade0a-4409-4f45-b07c-7323fbd836bb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd3qruavp {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:36.430374 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-71440e38-8767-41ff-8175-1ec3aa51bde5 req-6cacae05-61a7-4ae8-9ca5-d00321c67f87 service nova] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Updated VIF entry in instance network info cache for port 0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:41:36.430956 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-71440e38-8767-41ff-8175-1ec3aa51bde5 req-6cacae05-61a7-4ae8-9ca5-d00321c67f87 service nova] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Updating instance_info_cache with network_info: [{"id": "0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0", "address": "fa:16:3e:b0:e8:8f", "network": {"id": "fdf32429-f589-4e76-997e-ddfdb055d2fc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-863894942-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6eb74c8d593e41439c11018567cee50e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6c191b-4d", "ovs_interfaceid": "0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:41:36.432588 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c3fade0a-4409-4f45-b07c-7323fbd836bb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd3qruavp" returned: 0 in 0.041s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:36.621465 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:36.772031 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 5e52bd75-8566-4472-8147-99655013bc83] During sync_power_state the instance has a pending task (spawning). Skip. Jun 25 04:41:36.772370 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Paused> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:41:36.772437 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 5e52bd75-8566-4472-8147-99655013bc83] VM Paused (Lifecycle Event) Jun 25 04:41:36.788075 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Took 14.67 seconds to build instance. Jun 25 04:41:36.817480 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Creating config drive at /opt/stack/data/nova/instances/9333a704-82ad-4b54-8456-59eb035a2512/disk.config Jun 25 04:41:36.823780 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9333a704-82ad-4b54-8456-59eb035a2512/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5s8drx6j {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:36.864118 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9333a704-82ad-4b54-8456-59eb035a2512/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5s8drx6j" returned: 0 in 0.040s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:36.934162 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-71440e38-8767-41ff-8175-1ec3aa51bde5 req-6cacae05-61a7-4ae8-9ca5-d00321c67f87 service nova] Releasing lock "refresh_cache-54721bc9-c45c-4cb1-9910-f47334e84cd2" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:41:36.961391 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:36.996516 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:36.999197 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:37.112583 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-147275e3-0e44-4eba-8b98-24b70efb8f1b tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk --force-share --output=json -f qcow2 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:37.202921 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-147275e3-0e44-4eba-8b98-24b70efb8f1b tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk --force-share --output=json -f qcow2" returned: 0 in 0.091s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:37.204612 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-147275e3-0e44-4eba-8b98-24b70efb8f1b tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk --force-share --output=json -f qcow2 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:37.214548 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:37.258038 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:41:37.258859 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:41:37.258859 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:41:37.259420 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:41:37.259420 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:41:37.260092 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:41:37.260403 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:41:37.260802 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98952) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 25 04:41:37.260939 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:41:37.271985 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-a51327fa-1ee1-41c1-abfb-f3b7cb9251fb req-172c4d60-762c-44ba-bc3c-23b91fbf8157 service nova] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Received event network-vif-plugged-0030c2aa-ca73-4a59-a23c-2b1e3864d2fb {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:41:37.272842 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a51327fa-1ee1-41c1-abfb-f3b7cb9251fb req-172c4d60-762c-44ba-bc3c-23b91fbf8157 service nova] Acquiring lock "c3fade0a-4409-4f45-b07c-7323fbd836bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:37.272842 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a51327fa-1ee1-41c1-abfb-f3b7cb9251fb req-172c4d60-762c-44ba-bc3c-23b91fbf8157 service nova] Lock "c3fade0a-4409-4f45-b07c-7323fbd836bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:37.273846 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a51327fa-1ee1-41c1-abfb-f3b7cb9251fb req-172c4d60-762c-44ba-bc3c-23b91fbf8157 service nova] Lock "c3fade0a-4409-4f45-b07c-7323fbd836bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:37.273846 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-a51327fa-1ee1-41c1-abfb-f3b7cb9251fb req-172c4d60-762c-44ba-bc3c-23b91fbf8157 service nova] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Processing event network-vif-plugged-0030c2aa-ca73-4a59-a23c-2b1e3864d2fb {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:41:37.278035 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:41:37.286813 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:41:37.286813 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 5e52bd75-8566-4472-8147-99655013bc83] VM Resumed (Lifecycle Event) Jun 25 04:41:37.291048 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb62921c-c549-413b-8413-79cc6a53a93f tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "5e52bd75-8566-4472-8147-99655013bc83" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.176s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:37.293938 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-147275e3-0e44-4eba-8b98-24b70efb8f1b tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk --force-share --output=json -f qcow2" returned: 0 in 0.088s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:37.294664 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-147275e3-0e44-4eba-8b98-24b70efb8f1b tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:41:37.302865 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-147275e3-0e44-4eba-8b98-24b70efb8f1b tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:41:37.303335 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-147275e3-0e44-4eba-8b98-24b70efb8f1b tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:37.379012 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:41:37.379197 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:41:37.379524 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] No VIF found with MAC fa:16:3e:b0:e8:8f, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:41:37.381567 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Using config drive Jun 25 04:41:37.413172 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-147275e3-0e44-4eba-8b98-24b70efb8f1b tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.110s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:37.413660 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-147275e3-0e44-4eba-8b98-24b70efb8f1b tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfyj3jare/0387bb2d8b9f474da2489247c4e92515.delta 1073741824 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:37.430452 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:37.474782 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:37.484305 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-147275e3-0e44-4eba-8b98-24b70efb8f1b tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfyj3jare/0387bb2d8b9f474da2489247c4e92515.delta 1073741824" returned: 0 in 0.070s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:37.484855 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-147275e3-0e44-4eba-8b98-24b70efb8f1b tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Quiescing instance not available: QEMU guest agent is not enabled. Jun 25 04:41:37.508251 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-c37446f1-90ad-4d13-b570-658dd0c88ac7 req-c19eaa2f-2677-41c0-a905-8a10c3b16e2d service nova] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Received event network-vif-plugged-816a6c6d-d655-46f8-9f8e-7b6bde2e2e50 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:41:37.508545 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-c37446f1-90ad-4d13-b570-658dd0c88ac7 req-c19eaa2f-2677-41c0-a905-8a10c3b16e2d service nova] Acquiring lock "5e52bd75-8566-4472-8147-99655013bc83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:37.509255 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-c37446f1-90ad-4d13-b570-658dd0c88ac7 req-c19eaa2f-2677-41c0-a905-8a10c3b16e2d service nova] Lock "5e52bd75-8566-4472-8147-99655013bc83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:37.513078 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-c37446f1-90ad-4d13-b570-658dd0c88ac7 req-c19eaa2f-2677-41c0-a905-8a10c3b16e2d service nova] Lock "5e52bd75-8566-4472-8147-99655013bc83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.004s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:37.513247 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-c37446f1-90ad-4d13-b570-658dd0c88ac7 req-c19eaa2f-2677-41c0-a905-8a10c3b16e2d service nova] [instance: 5e52bd75-8566-4472-8147-99655013bc83] No waiting events found dispatching network-vif-plugged-816a6c6d-d655-46f8-9f8e-7b6bde2e2e50 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:41:37.513399 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-c37446f1-90ad-4d13-b570-658dd0c88ac7 req-c19eaa2f-2677-41c0-a905-8a10c3b16e2d service nova] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Received unexpected event network-vif-plugged-816a6c6d-d655-46f8-9f8e-7b6bde2e2e50 for instance with vm_state active and task_state None. Jun 25 04:41:37.640592 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:37.657992 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:37.771308 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:37.771308 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:37.771709 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:37.771931 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Auditing locally available compute resources for np0000003587 (node: np0000003587) {{(pid=98952) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 25 04:41:37.799837 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:41:37.804822 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:41:37.894481 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:37.921236 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-147275e3-0e44-4eba-8b98-24b70efb8f1b tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98952) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jun 25 04:41:37.928999 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-147275e3-0e44-4eba-8b98-24b70efb8f1b tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Skipping quiescing instance: QEMU guest agent is not enabled. Jun 25 04:41:38.011118 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:38.055909 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:38.079689 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:38.092662 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:38.101279 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:38.108872 np0000003587 nova-compute[98952]: DEBUG nova.privsep.utils [None req-147275e3-0e44-4eba-8b98-24b70efb8f1b tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98952) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 25 04:41:38.111676 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-147275e3-0e44-4eba-8b98-24b70efb8f1b tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfyj3jare/0387bb2d8b9f474da2489247c4e92515.delta /opt/stack/data/nova/instances/snapshots/tmpfyj3jare/0387bb2d8b9f474da2489247c4e92515 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:38.134289 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:38.145183 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Creating config drive at /opt/stack/data/nova/instances/54721bc9-c45c-4cb1-9910-f47334e84cd2/disk.config Jun 25 04:41:38.154950 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/54721bc9-c45c-4cb1-9910-f47334e84cd2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpagy7fktb {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:38.193421 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/54721bc9-c45c-4cb1-9910-f47334e84cd2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpagy7fktb" returned: 0 in 0.041s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:38.274876 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-147275e3-0e44-4eba-8b98-24b70efb8f1b tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfyj3jare/0387bb2d8b9f474da2489247c4e92515.delta /opt/stack/data/nova/instances/snapshots/tmpfyj3jare/0387bb2d8b9f474da2489247c4e92515" returned: 0 in 0.165s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:38.275416 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-147275e3-0e44-4eba-8b98-24b70efb8f1b tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Snapshot extracted, beginning image upload Jun 25 04:41:38.303886 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-e53e1bf0-896c-4ccc-a4ff-b2900860a54c req-cee7f285-0f74-48e4-8d78-644cb1690320 service nova] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Received event network-vif-plugged-5c0f7808-e34f-40a7-8f2d-38eace20dd0a {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:41:38.305077 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-e53e1bf0-896c-4ccc-a4ff-b2900860a54c req-cee7f285-0f74-48e4-8d78-644cb1690320 service nova] Acquiring lock "9333a704-82ad-4b54-8456-59eb035a2512-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:38.305317 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-e53e1bf0-896c-4ccc-a4ff-b2900860a54c req-cee7f285-0f74-48e4-8d78-644cb1690320 service nova] Lock "9333a704-82ad-4b54-8456-59eb035a2512-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:38.305586 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-e53e1bf0-896c-4ccc-a4ff-b2900860a54c req-cee7f285-0f74-48e4-8d78-644cb1690320 service nova] Lock "9333a704-82ad-4b54-8456-59eb035a2512-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:38.305709 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-e53e1bf0-896c-4ccc-a4ff-b2900860a54c req-cee7f285-0f74-48e4-8d78-644cb1690320 service nova] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Processing event network-vif-plugged-5c0f7808-e34f-40a7-8f2d-38eace20dd0a {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:41:38.707458 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:38.738350 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:38.857441 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:39.111235 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:41:39.112621 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] VM Started (Lifecycle Event) Jun 25 04:41:39.114334 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:41:39.121312 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Guest created on hypervisor {{(pid=98952) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 25 04:41:39.124752 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:41:39.126919 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Instance spawned successfully. Jun 25 04:41:39.128294 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 25 04:41:39.131194 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Guest created on hypervisor {{(pid=98952) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 25 04:41:39.144987 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Instance spawned successfully. Jun 25 04:41:39.145546 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 25 04:41:39.158659 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:39.162440 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:39.168136 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:39.193081 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:39.368311 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8b722f33-1fc0-4008-b0d0-a055ac985686 req-92ca87c8-c5ec-4dba-b8f7-c72dd038d85b service nova] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Received event network-vif-plugged-0030c2aa-ca73-4a59-a23c-2b1e3864d2fb {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:41:39.368990 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8b722f33-1fc0-4008-b0d0-a055ac985686 req-92ca87c8-c5ec-4dba-b8f7-c72dd038d85b service nova] Acquiring lock "c3fade0a-4409-4f45-b07c-7323fbd836bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:39.368990 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8b722f33-1fc0-4008-b0d0-a055ac985686 req-92ca87c8-c5ec-4dba-b8f7-c72dd038d85b service nova] Lock "c3fade0a-4409-4f45-b07c-7323fbd836bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:39.368990 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8b722f33-1fc0-4008-b0d0-a055ac985686 req-92ca87c8-c5ec-4dba-b8f7-c72dd038d85b service nova] Lock "c3fade0a-4409-4f45-b07c-7323fbd836bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:39.369119 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8b722f33-1fc0-4008-b0d0-a055ac985686 req-92ca87c8-c5ec-4dba-b8f7-c72dd038d85b service nova] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] No waiting events found dispatching network-vif-plugged-0030c2aa-ca73-4a59-a23c-2b1e3864d2fb {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:41:39.369245 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-8b722f33-1fc0-4008-b0d0-a055ac985686 req-92ca87c8-c5ec-4dba-b8f7-c72dd038d85b service nova] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Received unexpected event network-vif-plugged-0030c2aa-ca73-4a59-a23c-2b1e3864d2fb for instance with vm_state building and task_state spawning. Jun 25 04:41:39.616337 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:41:39.624059 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:41:39.652541 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Found default for hw_cdrom_bus of ide {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:39.655014 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Found default for hw_disk_bus of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:39.655216 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Found default for hw_input_bus of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:39.655647 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Found default for hw_pointer_model of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:39.656042 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Found default for hw_video_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:39.656593 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Found default for hw_vif_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:39.663718 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Found default for hw_cdrom_bus of ide {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:39.663718 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Found default for hw_disk_bus of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:39.664446 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Found default for hw_input_bus of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:39.665990 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Found default for hw_pointer_model of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:39.665990 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Found default for hw_video_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:39.665990 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Found default for hw_vif_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:39.819767 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:39.965953 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3fade0a-4409-4f45-b07c-7323fbd836bb/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:40.051793 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3fade0a-4409-4f45-b07c-7323fbd836bb/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:40.052777 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3fade0a-4409-4f45-b07c-7323fbd836bb/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:40.130548 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] During sync_power_state the instance has a pending task (spawning). Skip. Jun 25 04:41:40.132067 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Paused> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:41:40.132067 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] VM Paused (Lifecycle Event) Jun 25 04:41:40.142771 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3fade0a-4409-4f45-b07c-7323fbd836bb/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:40.147453 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:40.179584 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Took 10.77 seconds to spawn the instance on the hypervisor. Jun 25 04:41:40.180308 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Took 8.78 seconds to spawn the instance on the hypervisor. Jun 25 04:41:40.180742 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:41:40.181646 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:41:40.264836 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:40.265663 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:40.358602 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:40.361973 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98952) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 25 04:41:40.367581 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e52bd75-8566-4472-8147-99655013bc83/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:40.401393 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Received event network-vif-plugged-5c0f7808-e34f-40a7-8f2d-38eace20dd0a {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:41:40.402392 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] Acquiring lock "9333a704-82ad-4b54-8456-59eb035a2512-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:40.402829 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] Lock "9333a704-82ad-4b54-8456-59eb035a2512-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:40.403169 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] Lock "9333a704-82ad-4b54-8456-59eb035a2512-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:40.403500 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] No waiting events found dispatching network-vif-plugged-5c0f7808-e34f-40a7-8f2d-38eace20dd0a {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:41:40.403852 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Received unexpected event network-vif-plugged-5c0f7808-e34f-40a7-8f2d-38eace20dd0a for instance with vm_state active and task_state None. Jun 25 04:41:40.404430 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Received event network-vif-plugged-0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:41:40.408867 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] Acquiring lock "54721bc9-c45c-4cb1-9910-f47334e84cd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:40.408867 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] Lock "54721bc9-c45c-4cb1-9910-f47334e84cd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:40.408867 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] Lock "54721bc9-c45c-4cb1-9910-f47334e84cd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:40.408867 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Processing event network-vif-plugged-0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0 {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:41:40.408867 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Received event network-changed-816a6c6d-d655-46f8-9f8e-7b6bde2e2e50 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:41:40.408867 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Refreshing instance network info cache due to event network-changed-816a6c6d-d655-46f8-9f8e-7b6bde2e2e50. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:41:40.408867 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] Acquiring lock "refresh_cache-5e52bd75-8566-4472-8147-99655013bc83" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:41:40.408867 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] Acquired lock "refresh_cache-5e52bd75-8566-4472-8147-99655013bc83" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:41:40.408867 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Refreshing network info cache for port 816a6c6d-d655-46f8-9f8e-7b6bde2e2e50 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:41:40.408867 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:41:40.412316 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Guest created on hypervisor {{(pid=98952) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 25 04:41:40.416700 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Instance spawned successfully. Jun 25 04:41:40.417198 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 25 04:41:40.456790 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e52bd75-8566-4472-8147-99655013bc83/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:40.457239 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e52bd75-8566-4472-8147-99655013bc83/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:40.538837 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e52bd75-8566-4472-8147-99655013bc83/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:40.543767 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54721bc9-c45c-4cb1-9910-f47334e84cd2/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:40.641816 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:41:40.644046 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54721bc9-c45c-4cb1-9910-f47334e84cd2/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:40.644046 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54721bc9-c45c-4cb1-9910-f47334e84cd2/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:40.658437 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:41:40.658768 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] VM Resumed (Lifecycle Event) Jun 25 04:41:40.706594 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Took 19.23 seconds to build instance. Jun 25 04:41:40.719054 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54721bc9-c45c-4cb1-9910-f47334e84cd2/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:40.726002 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Took 17.79 seconds to build instance. Jun 25 04:41:40.726476 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:41:40.727713 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:40.756912 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "env LANG=C uptime" returned: 0 in 0.029s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:40.758804 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Hypervisor/Node resource view: name=np0000003587 free_ram=52765MB free_disk=74.68349838256836GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98952) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 25 04:41:40.759213 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:40.760826 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:40.835610 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:40.912789 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:40.938186 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Found default for hw_cdrom_bus of ide {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:40.938186 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Found default for hw_disk_bus of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:40.938186 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Found default for hw_input_bus of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:40.952619 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Found default for hw_pointer_model of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:40.953236 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Found default for hw_video_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:40.958925 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Found default for hw_vif_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:41.169962 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:41:41.176211 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:41:41.213814 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d2ab6d7-64b8-4698-a87e-642f5ccb0237 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "9333a704-82ad-4b54-8456-59eb035a2512" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 20.749s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:41.242575 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4177d4b5-e007-4c31-a1c4-388d4a78ce14 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Lock "c3fade0a-4409-4f45-b07c-7323fbd836bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 19.318s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:41.470954 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Took 7.62 seconds to spawn the instance on the hypervisor. Jun 25 04:41:41.470954 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:41:41.597094 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:41.681289 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:41:41.681425 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] VM Started (Lifecycle Event) Jun 25 04:41:41.874856 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Updated VIF entry in instance network info cache for port 816a6c6d-d655-46f8-9f8e-7b6bde2e2e50. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:41:41.874856 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Updating instance_info_cache with network_info: [{"id": "816a6c6d-d655-46f8-9f8e-7b6bde2e2e50", "address": "fa:16:3e:5d:a0:ff", "network": {"id": "0c192e32-6947-44e6-b8c5-07d6f5f711af", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-940608449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c31b6cf6f5f4fff90914e329442d042", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap816a6c6d-d6", "ovs_interfaceid": "816a6c6d-d655-46f8-9f8e-7b6bde2e2e50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:41:41.877765 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 11145d6a-7a4f-4b00-8543-d9b51514d9de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:41:41.878799 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 9333a704-82ad-4b54-8456-59eb035a2512 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:41:41.878799 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 5e52bd75-8566-4472-8147-99655013bc83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:41:41.878799 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance c3fade0a-4409-4f45-b07c-7323fbd836bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:41:41.878799 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 54721bc9-c45c-4cb1-9910-f47334e84cd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:41:41.878963 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Total usable vcpus: 16, total allocated vcpus: 5 {{(pid=98952) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 25 04:41:41.879155 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Final resource view: name=np0000003587 phys_ram=64301MB used_ram=1472MB phys_disk=95GB used_disk=4GB total_vcpus=16 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:41:40 up 26 min, 2 users, load average: 7.69, 3.11, 1.46\n', 'num_instances': '5', 'num_vm_active': '4', 'num_task_image_uploading': '1', 'num_os_type_None': '5', 'num_proj_a5d52ed3b8de460eb65a8fb4ad1b015d': '1', 'io_workload': '1', 'num_task_None': '3', 'num_proj_284d191aa82f453cabcfd18172f74099': '1', 'num_proj_6c31b6cf6f5f4fff90914e329442d042': '1', 'num_proj_9cb9320b8eea43c5a20e2a3fcfb2c3dc': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_6eb74c8d593e41439c11018567cee50e': '1'} {{(pid=98952) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 25 04:41:41.990475 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Took 17.11 seconds to build instance. Jun 25 04:41:42.189145 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:41:42.201579 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:41:42.294588 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:41:42.294913 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:41:42.379487 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] Releasing lock "refresh_cache-5e52bd75-8566-4472-8147-99655013bc83" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:41:42.380408 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Received event network-vif-plugged-0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:41:42.380732 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] Acquiring lock "54721bc9-c45c-4cb1-9910-f47334e84cd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:42.380969 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] Lock "54721bc9-c45c-4cb1-9910-f47334e84cd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:42.381652 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] Lock "54721bc9-c45c-4cb1-9910-f47334e84cd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:42.381741 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] No waiting events found dispatching network-vif-plugged-0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:41:42.382484 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-1346e1f9-9003-4106-b164-a791e84bc512 req-0bbeae0f-1a36-419b-b948-1171e1f3b32e service nova] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Received unexpected event network-vif-plugged-0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0 for instance with vm_state building and task_state spawning. Jun 25 04:41:42.492692 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-209fd922-3c46-4f02-a54f-356a59a1bba4 tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Lock "54721bc9-c45c-4cb1-9910-f47334e84cd2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 18.621s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:42.702831 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Paused> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:41:42.703074 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] VM Paused (Lifecycle Event) Jun 25 04:41:42.799482 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:41:43.024856 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-147275e3-0e44-4eba-8b98-24b70efb8f1b tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Snapshot image upload complete Jun 25 04:41:43.025348 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-147275e3-0e44-4eba-8b98-24b70efb8f1b tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Took 7.57 seconds to snapshot the instance on the hypervisor. Jun 25 04:41:43.207723 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:41:43.214518 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:41:43.214518 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] VM Resumed (Lifecycle Event) Jun 25 04:41:43.312189 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Compute_service record updated for np0000003587:np0000003587 {{(pid=98952) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 25 04:41:43.315601 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.556s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:43.316767 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._threading.loopingcall [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 56.73 seconds {{(pid=98952) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 25 04:41:43.721189 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:41:43.725816 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9333a704-82ad-4b54-8456-59eb035a2512] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:41:44.229238 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:41:44.229997 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] VM Started (Lifecycle Event) Jun 25 04:41:44.279086 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d387214e-aa2e-436b-86e5-47680bdb9144 req-8969b813-4443-4f91-b0ad-f865c225b8ab service nova] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Received event network-changed-0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:41:44.279307 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d387214e-aa2e-436b-86e5-47680bdb9144 req-8969b813-4443-4f91-b0ad-f865c225b8ab service nova] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Refreshing instance network info cache due to event network-changed-0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:41:44.281291 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d387214e-aa2e-436b-86e5-47680bdb9144 req-8969b813-4443-4f91-b0ad-f865c225b8ab service nova] Acquiring lock "refresh_cache-54721bc9-c45c-4cb1-9910-f47334e84cd2" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:41:44.281291 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d387214e-aa2e-436b-86e5-47680bdb9144 req-8969b813-4443-4f91-b0ad-f865c225b8ab service nova] Acquired lock "refresh_cache-54721bc9-c45c-4cb1-9910-f47334e84cd2" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:41:44.281291 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-d387214e-aa2e-436b-86e5-47680bdb9144 req-8969b813-4443-4f91-b0ad-f865c225b8ab service nova] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Refreshing network info cache for port 0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:41:44.443062 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:44.736714 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:41:44.742783 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:41:44.785868 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-d387214e-aa2e-436b-86e5-47680bdb9144 req-8969b813-4443-4f91-b0ad-f865c225b8ab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:44.823253 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:45.206990 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:45.229109 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9e59d4f1-2982-47db-aba5-7bbf41ca3b97 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Acquiring lock "c3fade0a-4409-4f45-b07c-7323fbd836bb" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:45.229912 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9e59d4f1-2982-47db-aba5-7bbf41ca3b97 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Lock "c3fade0a-4409-4f45-b07c-7323fbd836bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:45.229912 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9e59d4f1-2982-47db-aba5-7bbf41ca3b97 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Acquiring lock "c3fade0a-4409-4f45-b07c-7323fbd836bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:45.230604 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9e59d4f1-2982-47db-aba5-7bbf41ca3b97 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Lock "c3fade0a-4409-4f45-b07c-7323fbd836bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:45.230604 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9e59d4f1-2982-47db-aba5-7bbf41ca3b97 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Lock "c3fade0a-4409-4f45-b07c-7323fbd836bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:45.233951 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-9e59d4f1-2982-47db-aba5-7bbf41ca3b97 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Terminating instance Jun 25 04:41:45.249151 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Paused> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:41:45.249968 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] VM Paused (Lifecycle Event) Jun 25 04:41:45.382542 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-d387214e-aa2e-436b-86e5-47680bdb9144 req-8969b813-4443-4f91-b0ad-f865c225b8ab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:45.615108 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-d387214e-aa2e-436b-86e5-47680bdb9144 req-8969b813-4443-4f91-b0ad-f865c225b8ab service nova] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Updated VIF entry in instance network info cache for port 0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:41:45.615814 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-d387214e-aa2e-436b-86e5-47680bdb9144 req-8969b813-4443-4f91-b0ad-f865c225b8ab service nova] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Updating instance_info_cache with network_info: [{"id": "0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0", "address": "fa:16:3e:b0:e8:8f", "network": {"id": "fdf32429-f589-4e76-997e-ddfdb055d2fc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-863894942-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6eb74c8d593e41439c11018567cee50e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6c191b-4d", "ovs_interfaceid": "0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:41:45.744393 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-9e59d4f1-2982-47db-aba5-7bbf41ca3b97 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Start destroying the instance on the hypervisor. {{(pid=98952) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 25 04:41:45.757007 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:41:45.760587 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:41:45.760587 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] VM Resumed (Lifecycle Event) Jun 25 04:41:45.769587 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:45.799240 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:45.806974 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:45.831646 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:45.836818 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:45.860215 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:45.860473 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:45.957398 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "9aa3370c-9525-460d-b6fc-40a6461bd725" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:45.957398 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:46.120674 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d387214e-aa2e-436b-86e5-47680bdb9144 req-8969b813-4443-4f91-b0ad-f865c225b8ab service nova] Releasing lock "refresh_cache-54721bc9-c45c-4cb1-9910-f47334e84cd2" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:41:46.127927 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Instance destroyed successfully. Jun 25 04:41:46.129662 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-9e59d4f1-2982-47db-aba5-7bbf41ca3b97 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Lazy-loading 'resources' on Instance uuid c3fade0a-4409-4f45-b07c-7323fbd836bb {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:41:46.264581 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:41:46.266472 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:41:46.365581 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:41:46.457273 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:41:46.632893 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-9e59d4f1-2982-47db-aba5-7bbf41ca3b97 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:41:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-782605093',display_name='tempest-VolumesAdminNegativeTest-server-782605093',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-volumesadminnegativetest-server-782605093',id=4,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-25T04:41:40Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='9cb9320b8eea43c5a20e2a3fcfb2c3dc',ramdisk_id='',reservation_id='r-w0s5uazx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2037926086',owner_user_name='tempest-VolumesAdminNegativeTest-2037926086-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:41:40Z,user_data=None,user_id='950b42e61fcf44b5bf32db2678cf1907',uuid=c3fade0a-4409-4f45-b07c-7323fbd836bb,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0030c2aa-ca73-4a59-a23c-2b1e3864d2fb", "address": "fa:16:3e:aa:1a:04", "network": {"id": "e6d1e426-4d58-4466-8f0e-ff171a5896ad", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521310257-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9cb9320b8eea43c5a20e2a3fcfb2c3dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0030c2aa-ca", "ovs_interfaceid": "0030c2aa-ca73-4a59-a23c-2b1e3864d2fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:41:46.633124 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-9e59d4f1-2982-47db-aba5-7bbf41ca3b97 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Converting VIF {"id": "0030c2aa-ca73-4a59-a23c-2b1e3864d2fb", "address": "fa:16:3e:aa:1a:04", "network": {"id": "e6d1e426-4d58-4466-8f0e-ff171a5896ad", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-521310257-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9cb9320b8eea43c5a20e2a3fcfb2c3dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0030c2aa-ca", "ovs_interfaceid": "0030c2aa-ca73-4a59-a23c-2b1e3864d2fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:41:46.633862 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-9e59d4f1-2982-47db-aba5-7bbf41ca3b97 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:1a:04,bridge_name='br-int',has_traffic_filtering=True,id=0030c2aa-ca73-4a59-a23c-2b1e3864d2fb,network=Network(e6d1e426-4d58-4466-8f0e-ff171a5896ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0030c2aa-ca') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:41:46.634160 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-9e59d4f1-2982-47db-aba5-7bbf41ca3b97 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:1a:04,bridge_name='br-int',has_traffic_filtering=True,id=0030c2aa-ca73-4a59-a23c-2b1e3864d2fb,network=Network(e6d1e426-4d58-4466-8f0e-ff171a5896ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0030c2aa-ca') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:41:46.639750 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:46.639750 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0030c2aa-ca, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:46.642766 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:46.642766 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:41:46.644646 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:46.644646 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=567e73ff-4a42-498f-94c9-80f403782e17) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:46.645525 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:46.646341 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:41:46.649538 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:46.651906 np0000003587 nova-compute[98952]: INFO os_vif [None req-9e59d4f1-2982-47db-aba5-7bbf41ca3b97 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:1a:04,bridge_name='br-int',has_traffic_filtering=True,id=0030c2aa-ca73-4a59-a23c-2b1e3864d2fb,network=Network(e6d1e426-4d58-4466-8f0e-ff171a5896ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0030c2aa-ca') Jun 25 04:41:46.652317 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-9e59d4f1-2982-47db-aba5-7bbf41ca3b97 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Deleting instance files /opt/stack/data/nova/instances/c3fade0a-4409-4f45-b07c-7323fbd836bb_del Jun 25 04:41:46.656791 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-9e59d4f1-2982-47db-aba5-7bbf41ca3b97 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Deletion of /opt/stack/data/nova/instances/c3fade0a-4409-4f45-b07c-7323fbd836bb_del complete Jun 25 04:41:46.771873 np0000003587 nova-compute[98952]: DEBUG nova.utils [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Queued Task(fn=>, remaining_delay=14.999156654999979 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:41:46.772056 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.998917089000088 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:41:46.772150 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.998811113000102 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:41:46.950452 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:46.950714 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:46.955540 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:41:46.956455 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Claim successful on node np0000003587 Jun 25 04:41:47.047048 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:47.123898 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:47.168907 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-9e59d4f1-2982-47db-aba5-7bbf41ca3b97 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Took 1.42 seconds to destroy the instance on the hypervisor. Jun 25 04:41:47.171321 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._common.loopingcall [None req-9e59d4f1-2982-47db-aba5-7bbf41ca3b97 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98952) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 25 04:41:47.171680 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [-] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Deallocating network for instance {{(pid=98952) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 25 04:41:47.171680 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] deallocate_for_instance() {{(pid=98952) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 25 04:41:47.171959 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:47.266213 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:47.578069 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d51b6aec-33e7-4335-96a0-eaa1cb16c4b2 req-d7acda3d-77d7-4a2a-b728-9e0217125321 service nova] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Received event network-vif-unplugged-0030c2aa-ca73-4a59-a23c-2b1e3864d2fb {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:41:47.578247 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d51b6aec-33e7-4335-96a0-eaa1cb16c4b2 req-d7acda3d-77d7-4a2a-b728-9e0217125321 service nova] Acquiring lock "c3fade0a-4409-4f45-b07c-7323fbd836bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:47.579215 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d51b6aec-33e7-4335-96a0-eaa1cb16c4b2 req-d7acda3d-77d7-4a2a-b728-9e0217125321 service nova] Lock "c3fade0a-4409-4f45-b07c-7323fbd836bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:47.579215 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d51b6aec-33e7-4335-96a0-eaa1cb16c4b2 req-d7acda3d-77d7-4a2a-b728-9e0217125321 service nova] Lock "c3fade0a-4409-4f45-b07c-7323fbd836bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:47.579415 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d51b6aec-33e7-4335-96a0-eaa1cb16c4b2 req-d7acda3d-77d7-4a2a-b728-9e0217125321 service nova] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] No waiting events found dispatching network-vif-unplugged-0030c2aa-ca73-4a59-a23c-2b1e3864d2fb {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:41:47.579676 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d51b6aec-33e7-4335-96a0-eaa1cb16c4b2 req-d7acda3d-77d7-4a2a-b728-9e0217125321 service nova] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Received event network-vif-unplugged-0030c2aa-ca73-4a59-a23c-2b1e3864d2fb for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:41:47.720035 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-3d8c8831-8efb-4d78-9202-580afad7e7c8 req-04ab98ba-66be-4e1d-9a3c-29bad76d5a1a service nova] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Received event network-vif-deleted-0030c2aa-ca73-4a59-a23c-2b1e3864d2fb {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:41:47.720035 np0000003587 nova-compute[98952]: INFO nova.compute.manager [req-3d8c8831-8efb-4d78-9202-580afad7e7c8 req-04ab98ba-66be-4e1d-9a3c-29bad76d5a1a service nova] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Neutron deleted interface 0030c2aa-ca73-4a59-a23c-2b1e3864d2fb; detaching it from the instance and deleting it from the info cache Jun 25 04:41:47.721842 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-3d8c8831-8efb-4d78-9202-580afad7e7c8 req-04ab98ba-66be-4e1d-9a3c-29bad76d5a1a service nova] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Detach interface failed, port_id=0030c2aa-ca73-4a59-a23c-2b1e3864d2fb, reason: Instance c3fade0a-4409-4f45-b07c-7323fbd836bb could not be found. {{(pid=98952) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 25 04:41:48.150904 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:41:48.414702 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:41:48.415159 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:41:48.653224 np0000003587 nova-compute[98952]: INFO nova.compute.manager [-] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Took 1.48 seconds to deallocate network for instance. Jun 25 04:41:48.918876 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:41:49.161142 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9e59d4f1-2982-47db-aba5-7bbf41ca3b97 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:49.429089 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.478s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:49.429699 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:41:49.433057 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.386s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:49.436340 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:41:49.436510 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Claim successful on node np0000003587 Jun 25 04:41:49.673695 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-efd7e356-b25c-4763-a51d-994114818def req-15c2e377-00eb-47f8-b0bb-bcf132362723 service nova] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Received event network-vif-unplugged-0030c2aa-ca73-4a59-a23c-2b1e3864d2fb {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:41:49.674409 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-efd7e356-b25c-4763-a51d-994114818def req-15c2e377-00eb-47f8-b0bb-bcf132362723 service nova] Acquiring lock "c3fade0a-4409-4f45-b07c-7323fbd836bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:49.674620 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-efd7e356-b25c-4763-a51d-994114818def req-15c2e377-00eb-47f8-b0bb-bcf132362723 service nova] Lock "c3fade0a-4409-4f45-b07c-7323fbd836bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:49.674771 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-efd7e356-b25c-4763-a51d-994114818def req-15c2e377-00eb-47f8-b0bb-bcf132362723 service nova] Lock "c3fade0a-4409-4f45-b07c-7323fbd836bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:49.675115 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-efd7e356-b25c-4763-a51d-994114818def req-15c2e377-00eb-47f8-b0bb-bcf132362723 service nova] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] No waiting events found dispatching network-vif-unplugged-0030c2aa-ca73-4a59-a23c-2b1e3864d2fb {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:41:49.675383 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-efd7e356-b25c-4763-a51d-994114818def req-15c2e377-00eb-47f8-b0bb-bcf132362723 service nova] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Received unexpected event network-vif-unplugged-0030c2aa-ca73-4a59-a23c-2b1e3864d2fb for instance with vm_state deleted and task_state None. Jun 25 04:41:49.832054 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:49.946970 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:41:49.951802 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:41:49.952462 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:49.952462 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:50.060681 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '947bde0e827c45f5bab008d094816d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284d191aa82f453cabcfd18172f74099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:41:50.452179 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 25 04:41:50.698895 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Successfully created port: 7341532c-194f-4377-b054-438f19235507 {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:41:50.960404 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Start building block device mappings for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 25 04:41:50.964502 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:41:50.965519 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:41:51.467879 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:41:51.646593 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:51.812972 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Successfully updated port: 7341532c-194f-4377-b054-438f19235507 {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:41:51.863872 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-b9677124-a865-4f48-a0aa-d2df824005c7 req-0e16d4a4-268a-420f-9bf6-9a67d542a52b service nova] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Received event network-changed-7341532c-194f-4377-b054-438f19235507 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:41:51.864160 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-b9677124-a865-4f48-a0aa-d2df824005c7 req-0e16d4a4-268a-420f-9bf6-9a67d542a52b service nova] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Refreshing instance network info cache due to event network-changed-7341532c-194f-4377-b054-438f19235507. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:41:51.864338 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b9677124-a865-4f48-a0aa-d2df824005c7 req-0e16d4a4-268a-420f-9bf6-9a67d542a52b service nova] Acquiring lock "refresh_cache-6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:41:51.864437 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b9677124-a865-4f48-a0aa-d2df824005c7 req-0e16d4a4-268a-420f-9bf6-9a67d542a52b service nova] Acquired lock "refresh_cache-6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:41:51.864569 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-b9677124-a865-4f48-a0aa-d2df824005c7 req-0e16d4a4-268a-420f-9bf6-9a67d542a52b service nova] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Refreshing network info cache for port 7341532c-194f-4377-b054-438f19235507 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:41:51.974762 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Start spawning the instance on the hypervisor. {{(pid=98952) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 25 04:41:51.976435 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.544s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:51.977054 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Creating instance directory {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 25 04:41:51.977343 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Creating image(s) Jun 25 04:41:51.978012 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:41:51.979783 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9e59d4f1-2982-47db-aba5-7bbf41ca3b97 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.816s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:51.980742 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:51.980899 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "/opt/stack/data/nova/instances/6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.003s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:51.983188 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "/opt/stack/data/nova/instances/6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:51.983707 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:41:51.992735 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:41:51.994084 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:52.081954 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.087s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:52.082246 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:52.082689 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:52.083083 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:41:52.089852 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:41:52.090292 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:52.166391 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.076s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:52.167937 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d/disk 1073741824 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:52.225249 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d/disk 1073741824" returned: 0 in 0.057s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:52.229858 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.147s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:52.230126 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:52.316747 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "refresh_cache-6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:41:52.330416 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.100s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:52.331876 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d/disk. size=1073741824 {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 25 04:41:52.332150 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:52.368928 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-b9677124-a865-4f48-a0aa-d2df824005c7 req-0e16d4a4-268a-420f-9bf6-9a67d542a52b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:52.420542 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:52.420759 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Cannot resize image /opt/stack/data/nova/instances/6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d/disk to a smaller size. {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 25 04:41:52.421133 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Created local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 25 04:41:52.421297 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Ensure instance console log exists: /opt/stack/data/nova/instances/6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:41:52.421595 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:52.421835 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:52.422000 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:52.472899 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-b9677124-a865-4f48-a0aa-d2df824005c7 req-0e16d4a4-268a-420f-9bf6-9a67d542a52b service nova] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:41:52.486212 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:41:52.486691 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:41:52.487039 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:52.487258 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:52.521215 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-9e59d4f1-2982-47db-aba5-7bbf41ca3b97 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:41:52.521438 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-9e59d4f1-2982-47db-aba5-7bbf41ca3b97 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:41:52.606711 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27ebe4b23b624995a52b9313ff9e318a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d52ed3b8de460eb65a8fb4ad1b015d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:41:52.714163 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-b9677124-a865-4f48-a0aa-d2df824005c7 req-0e16d4a4-268a-420f-9bf6-9a67d542a52b service nova] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:41:52.989975 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 25 04:41:53.024362 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-9e59d4f1-2982-47db-aba5-7bbf41ca3b97 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:41:53.216508 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b9677124-a865-4f48-a0aa-d2df824005c7 req-0e16d4a4-268a-420f-9bf6-9a67d542a52b service nova] Releasing lock "refresh_cache-6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:41:53.217586 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquired lock "refresh_cache-6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:41:53.217767 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:41:53.496516 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Start building block device mappings for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 25 04:41:53.533649 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9e59d4f1-2982-47db-aba5-7bbf41ca3b97 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.557s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:53.566680 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Successfully created port: 62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:41:53.643531 np0000003587 nova-compute[98952]: INFO nova.scheduler.client.report [None req-9e59d4f1-2982-47db-aba5-7bbf41ca3b97 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Deleted allocations for instance c3fade0a-4409-4f45-b07c-7323fbd836bb Jun 25 04:41:53.831755 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:41:54.003456 np0000003587 nova-compute[98952]: INFO nova.virt.block_device [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Booting with blank volume at /dev/vda Jun 25 04:41:54.026309 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:54.223096 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Updating instance_info_cache with network_info: [{"id": "7341532c-194f-4377-b054-438f19235507", "address": "fa:16:3e:3a:48:58", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7341532c-19", "ovs_interfaceid": "7341532c-194f-4377-b054-438f19235507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:41:54.391051 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Successfully updated port: 62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:41:54.464488 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-e5ce2a6f-c63f-40d2-b4d9-2f6205280264 req-a08d9630-9b0d-41d6-a890-a831600c63a0 service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Received event network-changed-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:41:54.464629 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-e5ce2a6f-c63f-40d2-b4d9-2f6205280264 req-a08d9630-9b0d-41d6-a890-a831600c63a0 service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Refreshing instance network info cache due to event network-changed-62e285cd-c2d8-4883-a400-d57367b20980. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:41:54.464846 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-e5ce2a6f-c63f-40d2-b4d9-2f6205280264 req-a08d9630-9b0d-41d6-a890-a831600c63a0 service nova] Acquiring lock "refresh_cache-9aa3370c-9525-460d-b6fc-40a6461bd725" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:41:54.465335 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-e5ce2a6f-c63f-40d2-b4d9-2f6205280264 req-a08d9630-9b0d-41d6-a890-a831600c63a0 service nova] Acquired lock "refresh_cache-9aa3370c-9525-460d-b6fc-40a6461bd725" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:41:54.465489 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-e5ce2a6f-c63f-40d2-b4d9-2f6205280264 req-a08d9630-9b0d-41d6-a890-a831600c63a0 service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Refreshing network info cache for port 62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:41:54.655826 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9e59d4f1-2982-47db-aba5-7bbf41ca3b97 tempest-VolumesAdminNegativeTest-2037926086 tempest-VolumesAdminNegativeTest-2037926086-project-member] Lock "c3fade0a-4409-4f45-b07c-7323fbd836bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 9.426s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:54.726294 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Releasing lock "refresh_cache-6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:41:54.726294 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Instance network_info: |[{"id": "7341532c-194f-4377-b054-438f19235507", "address": "fa:16:3e:3a:48:58", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7341532c-19", "ovs_interfaceid": "7341532c-194f-4377-b054-438f19235507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 25 04:41:54.730224 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Start _get_guest_xml network_info=[{"id": "7341532c-194f-4377-b054-438f19235507", "address": "fa:16:3e:3a:48:58", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7341532c-19", "ovs_interfaceid": "7341532c-194f-4377-b054-438f19235507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '4ecaf199-c1b9-4ce3-869c-178c170c1662'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:41:54.733870 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:41:54.735606 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d'), owner=OwnerMeta(userid='947bde0e827c45f5bab008d094816d8c', username='tempest-AttachVolumeMultiAttachTest-1256899935-project-member', projectid='284d191aa82f453cabcfd18172f74099', projectname='tempest-AttachVolumeMultiAttachTest-1256899935'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7341532c-194f-4377-b054-438f19235507", "address": "fa:16:3e:3a:48:58", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7341532c-19", "ovs_interfaceid": "7341532c-194f-4377-b054-438f19235507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362514.7350297) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:41:54.737327 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:41:54.737517 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:41:54.738400 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:41:54.738634 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:41:54.739753 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:41:54.740193 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:41:54.742029 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:41:54.742029 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:41:54.742029 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:41:54.742029 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:41:54.742029 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:41:54.742029 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:41:54.742029 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:41:54.742282 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:41:54.742333 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:41:54.742488 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:41:54.762863 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:41:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='multiattach-server-0',id=6,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV/p3ZeuUk+pDtRyjEqB6LGacp/8M+rMj60nbQpQu7IIRoy9lFRhD1vsgSIFDZ+PjS4ytFpGVQZ3frW+0uH/J+qnA92sFXepo+od7tCOydqRChW2tpsraqZi+iIk6G08A==',key_name='tempest-keypair-462979399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='284d191aa82f453cabcfd18172f74099',ramdisk_id='',reservation_id='r-rjektzir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1256899935',owner_user_name='tempest-AttachVolumeMultiAttachTest-1256899935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='947bde0e827c45f5bab008d094816d8c',uuid=6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7341532c-194f-4377-b054-438f19235507", "address": "fa:16:3e:3a:48:58", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7341532c-19", "ovs_interfaceid": "7341532c-194f-4377-b054-438f19235507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:41:54.762863 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converting VIF {"id": "7341532c-194f-4377-b054-438f19235507", "address": "fa:16:3e:3a:48:58", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7341532c-19", "ovs_interfaceid": "7341532c-194f-4377-b054-438f19235507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:41:54.763530 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:48:58,bridge_name='br-int',has_traffic_filtering=True,id=7341532c-194f-4377-b054-438f19235507,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7341532c-19') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:41:54.764230 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:41:54.834253 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:54.893267 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "refresh_cache-9aa3370c-9525-460d-b6fc-40a6461bd725" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:41:54.971589 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-e5ce2a6f-c63f-40d2-b4d9-2f6205280264 req-a08d9630-9b0d-41d6-a890-a831600c63a0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:55.051771 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-e5ce2a6f-c63f-40d2-b4d9-2f6205280264 req-a08d9630-9b0d-41d6-a890-a831600c63a0 service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:41:55.255250 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-e5ce2a6f-c63f-40d2-b4d9-2f6205280264 req-a08d9630-9b0d-41d6-a890-a831600c63a0 service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] End _get_guest_xml xml= Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: instance-00000006 Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: 196608 Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: multiattach-server-0 Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: 2026-06-25 04:41:54 Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: 192 Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: 0 Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: 0 Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: True Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: bare Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: 0 Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: virtio Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: tempest-AttachVolumeMultiAttachTest-1256899935-project-member Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: tempest-AttachVolumeMultiAttachTest-1256899935 Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: hvm Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: 128 Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: 1 Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: Jun 25 04:41:55.270048 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:41:55.273341 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Preparing to wait for external event network-vif-plugged-7341532c-194f-4377-b054-438f19235507 {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:41:55.273341 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:55.273341 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:55.273341 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:55.273341 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:41:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='multiattach-server-0',id=6,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV/p3ZeuUk+pDtRyjEqB6LGacp/8M+rMj60nbQpQu7IIRoy9lFRhD1vsgSIFDZ+PjS4ytFpGVQZ3frW+0uH/J+qnA92sFXepo+od7tCOydqRChW2tpsraqZi+iIk6G08A==',key_name='tempest-keypair-462979399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='284d191aa82f453cabcfd18172f74099',ramdisk_id='',reservation_id='r-rjektzir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1256899935',owner_user_name='tempest-AttachVolumeMultiAttachTest-1256899935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='947bde0e827c45f5bab008d094816d8c',uuid=6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7341532c-194f-4377-b054-438f19235507", "address": "fa:16:3e:3a:48:58", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7341532c-19", "ovs_interfaceid": "7341532c-194f-4377-b054-438f19235507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:41:55.273745 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converting VIF {"id": "7341532c-194f-4377-b054-438f19235507", "address": "fa:16:3e:3a:48:58", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7341532c-19", "ovs_interfaceid": "7341532c-194f-4377-b054-438f19235507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:41:55.273745 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:48:58,bridge_name='br-int',has_traffic_filtering=True,id=7341532c-194f-4377-b054-438f19235507,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7341532c-19') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:41:55.274153 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:48:58,bridge_name='br-int',has_traffic_filtering=True,id=7341532c-194f-4377-b054-438f19235507,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7341532c-19') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:41:55.275156 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:55.276373 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:55.277147 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:41:55.279228 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:55.279454 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4b24ec7-f2a4-5576-84ba-a2835b481760', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:55.283955 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:55.284652 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:41:55.286163 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:55.289618 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:55.289618 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7341532c-19, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:55.289618 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7341532c-19, col_values=(('qos', UUID('21886c53-273a-4c2e-abb5-51533708e6ec')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:55.289873 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7341532c-19, col_values=(('external_ids', {'iface-id': '7341532c-194f-4377-b054-438f19235507', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:48:58', 'vm-uuid': '6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:41:55.290876 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:55.292442 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:41:55.300630 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:55.301884 np0000003587 nova-compute[98952]: INFO os_vif [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:48:58,bridge_name='br-int',has_traffic_filtering=True,id=7341532c-194f-4377-b054-438f19235507,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7341532c-19') Jun 25 04:41:55.757796 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-e5ce2a6f-c63f-40d2-b4d9-2f6205280264 req-a08d9630-9b0d-41d6-a890-a831600c63a0 service nova] Releasing lock "refresh_cache-9aa3370c-9525-460d-b6fc-40a6461bd725" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:41:55.758283 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquired lock "refresh_cache-9aa3370c-9525-460d-b6fc-40a6461bd725" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:41:55.758414 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:41:56.348401 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:41:56.624637 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:56.644730 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:56.831499 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:41:56.831499 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:41:56.831499 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No VIF found with MAC fa:16:3e:3a:48:58, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:41:56.831499 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Using config drive Jun 25 04:41:56.840434 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Updating instance_info_cache with network_info: [{"id": "62e285cd-c2d8-4883-a400-d57367b20980", "address": "fa:16:3e:e6:e0:22", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e285cd-c2", "ovs_interfaceid": "62e285cd-c2d8-4883-a400-d57367b20980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:41:57.337103 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:41:57.343123 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Releasing lock "refresh_cache-9aa3370c-9525-460d-b6fc-40a6461bd725" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:41:57.343645 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Instance network_info: |[{"id": "62e285cd-c2d8-4883-a400-d57367b20980", "address": "fa:16:3e:e6:e0:22", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e285cd-c2", "ovs_interfaceid": "62e285cd-c2d8-4883-a400-d57367b20980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 25 04:41:57.538432 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Creating config drive at /opt/stack/data/nova/instances/6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d/disk.config Jun 25 04:41:57.544057 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1kbnad3x {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:57.582634 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1kbnad3x" returned: 0 in 0.038s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:41:57.603733 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.80', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003587', 'execute': None}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:41:57.618394 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.scaleio [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98952) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 25 04:41:57.649918 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): nvme version {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:41:57.674053 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] 'nvme version' failed. Not Retrying. {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 04:41:57.674347 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] nvme not present on system {{(pid=98952) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 25 04:41:57.685886 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98952) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 25 04:41:57.687137 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.lightos [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Current host hostNQN and IP(s) are ['10.4.3.80', 'fe80::f816:3eff:feea:dfe4', '192.168.40.6', 'fe80::f816:3eff:fe4f:7c42', '192.168.50.6', 'fe80::f816:3eff:fe6c:e6a6', '192.168.10.6', 'fe80::f816:3eff:fe17:d749', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::b035:28ff:fe70:6f4a', 'fe80::fc16:3eff:fe8c:f883', 'fe80::483f:f2ff:fe48:75ca', 'fe80::fc16:3eff:fe5d:a0ff', 'fe80::b819:93ff:fef3:f5f3', 'fe80::fc16:3eff:fe78:7ac8', 'fe80::1038:1dff:fe1c:d44b', 'fe80::fc16:3eff:feb0:e88f', 'fe80::5c81:6cff:fe82:5221'] Jun 25 04:41:57.687282 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 25 04:41:57.687461 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] LIGHTOS: no hostnqn found. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 25 04:41:57.687852 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.80', 'host': 'np0000003587', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c81886224652', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a1feb13-40e2-4ac6-989e-b08a6fc0f283', 'nvme_native_multipath': False} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:41:57.688141 np0000003587 nova-compute[98952]: DEBUG nova.virt.block_device [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Updating existing volume attachment record: 310ec554-11e0-4d4a-9a26-9f655dfc1dcb {{(pid=98952) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 25 04:41:58.092467 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:58.116331 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:58.121028 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:58.237489 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:58.304051 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:58.304378 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:58.355893 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-c6d3c394-5b79-47b8-a33e-7da6fbb9d78e req-c7c56a18-5f64-4dd7-bb04-26a7ac3f3521 service nova] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Received event network-vif-plugged-7341532c-194f-4377-b054-438f19235507 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:41:58.357549 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-c6d3c394-5b79-47b8-a33e-7da6fbb9d78e req-c7c56a18-5f64-4dd7-bb04-26a7ac3f3521 service nova] Acquiring lock "6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:58.360565 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-c6d3c394-5b79-47b8-a33e-7da6fbb9d78e req-c7c56a18-5f64-4dd7-bb04-26a7ac3f3521 service nova] Lock "6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.003s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:58.360565 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-c6d3c394-5b79-47b8-a33e-7da6fbb9d78e req-c7c56a18-5f64-4dd7-bb04-26a7ac3f3521 service nova] Lock "6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:58.360565 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-c6d3c394-5b79-47b8-a33e-7da6fbb9d78e req-c7c56a18-5f64-4dd7-bb04-26a7ac3f3521 service nova] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Processing event network-vif-plugged-7341532c-194f-4377-b054-438f19235507 {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:41:59.182535 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:41:59.183275 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:41:59.183839 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] VM Started (Lifecycle Event) Jun 25 04:41:59.188840 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Guest created on hypervisor {{(pid=98952) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 25 04:41:59.195983 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Instance spawned successfully. Jun 25 04:41:59.198508 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 25 04:41:59.224292 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:59.691170 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:41:59.694385 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:41:59.706979 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Found default for hw_cdrom_bus of ide {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:59.706979 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Found default for hw_disk_bus of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:59.707255 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Found default for hw_input_bus of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:59.707400 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Found default for hw_pointer_model of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:59.707691 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Found default for hw_video_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:59.707949 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Found default for hw_vif_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:41:59.836674 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:41:59.889488 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Start spawning the instance on the hypervisor. {{(pid=98952) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 25 04:41:59.890576 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Creating instance directory {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 25 04:41:59.890895 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Creating image(s) Jun 25 04:41:59.891262 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Did not create local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 25 04:41:59.891426 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Ensure instance console log exists: /opt/stack/data/nova/instances/9aa3370c-9525-460d-b6fc-40a6461bd725/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:41:59.891917 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:41:59.892097 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:41:59.892237 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:41:59.892752 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Start _get_guest_xml network_info=[{"id": "62e285cd-c2d8-4883-a400-d57367b20980", "address": "fa:16:3e:e6:e0:22", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e285cd-c2", "ovs_interfaceid": "62e285cd-c2d8-4883-a400-d57367b20980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9aa3370c-9525-460d-b6fc-40a6461bd725', 'attached_at': '', 'detached_at': '', 'volume_id': '9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'serial': '9ed7fd1c-6933-4549-8acc-d425cd2d10a6'}, 'attachment_id': '310ec554-11e0-4d4a-9a26-9f655dfc1dcb', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:41:59.894962 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:41:59.896191 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1691757098', uuid='9aa3370c-9525-460d-b6fc-40a6461bd725'), owner=OwnerMeta(userid='27ebe4b23b624995a52b9313ff9e318a', username='tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member', projectid='a5d52ed3b8de460eb65a8fb4ad1b015d', projectname='tempest-ServerBootFromVolumeStableRescueTest-6878904'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "62e285cd-c2d8-4883-a400-d57367b20980", "address": "fa:16:3e:e6:e0:22", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e285cd-c2", "ovs_interfaceid": "62e285cd-c2d8-4883-a400-d57367b20980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362519.8958302) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:41:59.897137 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:41:59.897480 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:41:59.898328 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:41:59.898578 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:41:59.899542 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:41:59.899913 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:41:59.900216 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:41:59.900308 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:41:59.900459 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:41:59.900535 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:41:59.900656 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:41:59.900842 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:41:59.900951 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:41:59.901059 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:41:59.901192 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:41:59.901311 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:41:59.913147 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Calling os-brick to attach iSCSI Volume {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 25 04:41:59.913449 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:41:59.913599 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:41:59.914020 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:41:59.914473 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 25 04:41:59.928874 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:41:59.929190 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:41:59.929856 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:41:59.931732 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:41:59.932180 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:41:59.932628 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:41:59.946055 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:41:59.946055 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:41:59.952875 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:41:59.952875 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:41:59.961913 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6] added Jun 25 04:41:59.961913 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:41:59.961913 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:41:59.961913 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:41:59.961913 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:41:59.961913 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:41:59.961913 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:41:59.962512 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:41:59.962512 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0327(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:41:59.962879 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:41:59.969479 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6] added Jun 25 04:41:59.969479 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:41:59.969479 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:41:59.969479 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:41:59.969479 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:41:59.969479 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:41:59.969479 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:41:59.969479 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:41:59.969479 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0353(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:41:59.969479 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:42:00.198431 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] During sync_power_state the instance has a pending task (spawning). Skip. Jun 25 04:42:00.198981 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Paused> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:42:00.198981 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] VM Paused (Lifecycle Event) Jun 25 04:42:00.215125 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Took 8.24 seconds to spawn the instance on the hypervisor. Jun 25 04:42:00.215125 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:00.292440 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:00.454818 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-c26003e0-030e-4a1b-a69b-055edbee9390 req-e0148350-ca10-40ac-a568-9daeae60afc2 service nova] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Received event network-vif-plugged-7341532c-194f-4377-b054-438f19235507 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:00.454818 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-c26003e0-030e-4a1b-a69b-055edbee9390 req-e0148350-ca10-40ac-a568-9daeae60afc2 service nova] Acquiring lock "6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:00.456618 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-c26003e0-030e-4a1b-a69b-055edbee9390 req-e0148350-ca10-40ac-a568-9daeae60afc2 service nova] Lock "6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:00.456618 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-c26003e0-030e-4a1b-a69b-055edbee9390 req-e0148350-ca10-40ac-a568-9daeae60afc2 service nova] Lock "6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:00.456618 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-c26003e0-030e-4a1b-a69b-055edbee9390 req-e0148350-ca10-40ac-a568-9daeae60afc2 service nova] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] No waiting events found dispatching network-vif-plugged-7341532c-194f-4377-b054-438f19235507 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:42:00.457099 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-c26003e0-030e-4a1b-a69b-055edbee9390 req-e0148350-ca10-40ac-a568-9daeae60afc2 service nova] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Received unexpected event network-vif-plugged-7341532c-194f-4377-b054-438f19235507 for instance with vm_state active and task_state None. Jun 25 04:42:00.701410 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:00.703208 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:42:00.703443 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] VM Resumed (Lifecycle Event) Jun 25 04:42:00.727869 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Took 13.85 seconds to build instance. Jun 25 04:42:00.963336 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:42:00.969174 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.40.100 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:42:00.978150 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.50.100 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:42:00.986017 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:00.992945 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:01.001358 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:01.008200 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:01.008200 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:01.008200 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:01.008469 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:01.008469 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:01.008469 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:01.016031 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:01.016031 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:01.016031 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:01.016031 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:01.016031 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:01.016031 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:01.052377 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6, portal: 192.168.40.100,3260] Jun 25 04:42:01.052377 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6, portal: 192.168.40.100,3260] successful. Jun 25 04:42:01.052377 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:01.063452 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6, portal: 192.168.50.100,3260] Jun 25 04:42:01.063452 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6, portal: 192.168.50.100,3260] successful. Jun 25 04:42:01.063452 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:01.069521 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:01.077894 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:01.088269 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:01.088269 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:01.088269 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:01.088269 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:01.088269 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:01.089237 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:01.089237 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:01.089237 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:01.089237 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:01.089237 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:01.089425 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.160s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:01.090110 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Connected to 192.168.40.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:42:01.090750 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] HCTL ('9', '-', '-', 0) found on session 5 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:42:01.090750 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:42:01.096171 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:01.096171 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:01.096171 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:01.096171 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:01.096171 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:01.097803 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:01.097803 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:01.097803 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:01.097803 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:01.097803 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:01.097803 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:01.097803 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Connected to 192.168.50.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:42:01.097803 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] HCTL ('10', '-', '-', 0) found on session 6 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:42:01.097803 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:42:01.115203 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Searching for a device in session 5 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:42:01.115203 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:42:01.130057 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Searching for a device in session 6 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:42:01.130057 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:42:01.206775 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:01.210711 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:42:01.229791 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9a5085b3-0305-4fe4-9a01-64730959b244 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.369s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:01.772520 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0014627479999944626 future=) submitted to {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:42:01.773124 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:42:01.773195 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:42:01.773849 np0000003587 nova-compute[98952]: INFO nova.compute.manager [-] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] VM Stopped (Lifecycle Event) Jun 25 04:42:01.930874 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 25 04:42:02.115171 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:02.276954 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-88be2932-e387-4227-9949-1ced70617b75 None None] [instance: c3fade0a-4409-4f45-b07c-7323fbd836bb] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:02.949078 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Found WWN 33000000029752971 for multipath device dm-3 {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 25 04:42:02.950186 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:02.950431 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '33000000029752971', 'path': '/dev/dm-3', 'multipath_id': '33000000029752971'} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:42:02.950724 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000029752971', 'path': '/dev/dm-3', 'multipath_id': '33000000029752971'} {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 25 04:42:03.458744 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:41:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1691757098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-serverbootfromvolumestablerescuetest-server-1691757098',id=7,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5d52ed3b8de460eb65a8fb4ad1b015d',ramdisk_id='',reservation_id='r-8umk47p3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-6878904',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:41:54Z,user_data=None,user_id='27ebe4b23b624995a52b9313ff9e318a',uuid=9aa3370c-9525-460d-b6fc-40a6461bd725,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62e285cd-c2d8-4883-a400-d57367b20980", "address": "fa:16:3e:e6:e0:22", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e285cd-c2", "ovs_interfaceid": "62e285cd-c2d8-4883-a400-d57367b20980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:42:03.459534 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converting VIF {"id": "62e285cd-c2d8-4883-a400-d57367b20980", "address": "fa:16:3e:e6:e0:22", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e285cd-c2", "ovs_interfaceid": "62e285cd-c2d8-4883-a400-d57367b20980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:42:03.460539 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e0:22,bridge_name='br-int',has_traffic_filtering=True,id=62e285cd-c2d8-4883-a400-d57367b20980,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62e285cd-c2') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:42:03.461846 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'pci_devices' on Instance uuid 9aa3370c-9525-460d-b6fc-40a6461bd725 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:03.563527 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-31564331-1c46-4fd1-b1dc-9de8efcbc309 req-aa1ccdac-e066-4493-b558-1b7b17e051b6 service nova] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Received event network-changed-7341532c-194f-4377-b054-438f19235507 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:03.563911 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-31564331-1c46-4fd1-b1dc-9de8efcbc309 req-aa1ccdac-e066-4493-b558-1b7b17e051b6 service nova] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Refreshing instance network info cache due to event network-changed-7341532c-194f-4377-b054-438f19235507. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:42:03.563911 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-31564331-1c46-4fd1-b1dc-9de8efcbc309 req-aa1ccdac-e066-4493-b558-1b7b17e051b6 service nova] Acquiring lock "refresh_cache-6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:03.564296 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-31564331-1c46-4fd1-b1dc-9de8efcbc309 req-aa1ccdac-e066-4493-b558-1b7b17e051b6 service nova] Acquired lock "refresh_cache-6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:42:03.564347 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-31564331-1c46-4fd1-b1dc-9de8efcbc309 req-aa1ccdac-e066-4493-b558-1b7b17e051b6 service nova] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Refreshing network info cache for port 7341532c-194f-4377-b054-438f19235507 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:42:03.822975 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:03.828108 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "9c033870-f167-4235-86ff-98005452a16c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] End _get_guest_xml xml= Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: 9aa3370c-9525-460d-b6fc-40a6461bd725 Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: instance-00000007 Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: 196608 Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: tempest-ServerBootFromVolumeStableRescueTest-server-1691757098 Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: 2026-06-25 04:41:59 Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: 192 Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: 0 Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: 0 Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: True Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: bare Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: 0 Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: virtio Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: tempest-ServerBootFromVolumeStableRescueTest-6878904 Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: 9aa3370c-9525-460d-b6fc-40a6461bd725 Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: 9aa3370c-9525-460d-b6fc-40a6461bd725 Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: hvm Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: 128 Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: 9ed7fd1c-6933-4549-8acc-d425cd2d10a6 Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: Jun 25 04:42:03.968484 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:42:03.973144 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Preparing to wait for external event network-vif-plugged-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:42:03.973144 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:03.973144 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:03.973144 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:03.973144 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:41:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1691757098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-serverbootfromvolumestablerescuetest-server-1691757098',id=7,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5d52ed3b8de460eb65a8fb4ad1b015d',ramdisk_id='',reservation_id='r-8umk47p3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-6878904',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:41:54Z,user_data=None,user_id='27ebe4b23b624995a52b9313ff9e318a',uuid=9aa3370c-9525-460d-b6fc-40a6461bd725,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62e285cd-c2d8-4883-a400-d57367b20980", "address": "fa:16:3e:e6:e0:22", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e285cd-c2", "ovs_interfaceid": "62e285cd-c2d8-4883-a400-d57367b20980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:42:03.974573 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converting VIF {"id": "62e285cd-c2d8-4883-a400-d57367b20980", "address": "fa:16:3e:e6:e0:22", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e285cd-c2", "ovs_interfaceid": "62e285cd-c2d8-4883-a400-d57367b20980", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:42:03.974573 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e0:22,bridge_name='br-int',has_traffic_filtering=True,id=62e285cd-c2d8-4883-a400-d57367b20980,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62e285cd-c2') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:42:03.974573 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e0:22,bridge_name='br-int',has_traffic_filtering=True,id=62e285cd-c2d8-4883-a400-d57367b20980,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62e285cd-c2') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:42:03.974573 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:03.974573 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:03.974573 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:42:03.978639 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:03.978639 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '36a36966-a45a-5bf8-8398-0093c5c5a182', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:03.984068 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:03.984068 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:03.988566 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:03.988566 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62e285cd-c2, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:03.988566 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62e285cd-c2, col_values=(('qos', UUID('1c181ac9-3069-4e2a-9c9e-be5a15dac4f5')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:03.989197 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62e285cd-c2, col_values=(('external_ids', {'iface-id': '62e285cd-c2d8-4883-a400-d57367b20980', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:e0:22', 'vm-uuid': '9aa3370c-9525-460d-b6fc-40a6461bd725'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:03.992625 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:03.994435 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:04.000050 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:04.001323 np0000003587 nova-compute[98952]: INFO os_vif [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e0:22,bridge_name='br-int',has_traffic_filtering=True,id=62e285cd-c2d8-4883-a400-d57367b20980,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62e285cd-c2') Jun 25 04:42:04.067426 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-31564331-1c46-4fd1-b1dc-9de8efcbc309 req-aa1ccdac-e066-4493-b558-1b7b17e051b6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:04.332791 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:42:04.456826 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-31564331-1c46-4fd1-b1dc-9de8efcbc309 req-aa1ccdac-e066-4493-b558-1b7b17e051b6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:04.675994 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-31564331-1c46-4fd1-b1dc-9de8efcbc309 req-aa1ccdac-e066-4493-b558-1b7b17e051b6 service nova] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Updated VIF entry in instance network info cache for port 7341532c-194f-4377-b054-438f19235507. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:42:04.676400 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-31564331-1c46-4fd1-b1dc-9de8efcbc309 req-aa1ccdac-e066-4493-b558-1b7b17e051b6 service nova] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Updating instance_info_cache with network_info: [{"id": "7341532c-194f-4377-b054-438f19235507", "address": "fa:16:3e:3a:48:58", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7341532c-19", "ovs_interfaceid": "7341532c-194f-4377-b054-438f19235507", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:04.840018 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:04.893310 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:04.893519 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:04.895903 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:42:04.896020 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Claim successful on node np0000003587 Jun 25 04:42:05.179172 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-31564331-1c46-4fd1-b1dc-9de8efcbc309 req-aa1ccdac-e066-4493-b558-1b7b17e051b6 service nova] Releasing lock "refresh_cache-6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:42:05.219923 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "19180a23-a7e0-4354-b9f4-9ca57062fc06" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:05.220135 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "19180a23-a7e0-4354-b9f4-9ca57062fc06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:05.525983 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:42:05.526209 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:42:05.526407 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] No VIF found with MAC fa:16:3e:e6:e0:22, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:42:05.527053 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Using config drive Jun 25 04:42:05.723481 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:42:06.033101 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:06.231586 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Creating config drive at /opt/stack/data/nova/instances/9aa3370c-9525-460d-b6fc-40a6461bd725/disk.config Jun 25 04:42:06.243848 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9aa3370c-9525-460d-b6fc-40a6461bd725/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6gjkxgxv {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:06.288445 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9aa3370c-9525-460d-b6fc-40a6461bd725/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6gjkxgxv" returned: 0 in 0.044s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:06.314435 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:06.470849 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:42:06.471163 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:42:06.767906 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:06.796719 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:06.894046 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:06.964216 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:06.976191 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:42:07.018450 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1cd44bcc-d41b-4981-8d63-81bfac0f7b5c req-7bf6eafe-bf1e-4276-a577-b67f8e7a13c0 service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Received event network-vif-plugged-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:07.018597 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1cd44bcc-d41b-4981-8d63-81bfac0f7b5c req-7bf6eafe-bf1e-4276-a577-b67f8e7a13c0 service nova] Acquiring lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:07.018757 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1cd44bcc-d41b-4981-8d63-81bfac0f7b5c req-7bf6eafe-bf1e-4276-a577-b67f8e7a13c0 service nova] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:07.018933 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1cd44bcc-d41b-4981-8d63-81bfac0f7b5c req-7bf6eafe-bf1e-4276-a577-b67f8e7a13c0 service nova] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:07.019205 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1cd44bcc-d41b-4981-8d63-81bfac0f7b5c req-7bf6eafe-bf1e-4276-a577-b67f8e7a13c0 service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Processing event network-vif-plugged-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:42:07.490410 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.597s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:07.491049 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:42:07.494574 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.181s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:07.500762 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:42:07.500762 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Claim successful on node np0000003587 Jun 25 04:42:07.935266 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:42:07.936059 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:42:07.936278 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] VM Started (Lifecycle Event) Jun 25 04:42:07.945265 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Guest created on hypervisor {{(pid=98952) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 25 04:42:07.951046 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Instance spawned successfully. Jun 25 04:42:07.952028 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 25 04:42:07.999688 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:42:08.000199 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:42:08.000695 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:08.002367 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:08.311681 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be344ec982ae4676b6a89325d3578d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c1a4dead6ad4de1bb75262d9c52bbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:42:08.443462 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:08.447001 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:42:08.464263 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Found default for hw_cdrom_bus of ide {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:08.465234 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Found default for hw_disk_bus of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:08.465310 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Found default for hw_input_bus of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:08.465772 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Found default for hw_pointer_model of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:08.466097 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Found default for hw_video_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:08.466387 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Found default for hw_vif_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:08.502996 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 25 04:42:08.953271 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] During sync_power_state the instance has a pending task (spawning). Skip. Jun 25 04:42:08.954084 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Paused> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:42:08.955223 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] VM Paused (Lifecycle Event) Jun 25 04:42:08.973016 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Took 9.08 seconds to spawn the instance on the hypervisor. Jun 25 04:42:08.973543 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:08.995895 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:09.086447 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Successfully created port: e12da27e-2953-4784-80b6-5f7204f4e399 {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:42:09.142211 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d1eb9499-2441-4d39-8167-adc2bb643d7f req-bcb29194-ca5e-4686-b3f3-3bbe85a04977 service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Received event network-vif-plugged-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:09.142211 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d1eb9499-2441-4d39-8167-adc2bb643d7f req-bcb29194-ca5e-4686-b3f3-3bbe85a04977 service nova] Acquiring lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:09.143307 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d1eb9499-2441-4d39-8167-adc2bb643d7f req-bcb29194-ca5e-4686-b3f3-3bbe85a04977 service nova] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:09.143307 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d1eb9499-2441-4d39-8167-adc2bb643d7f req-bcb29194-ca5e-4686-b3f3-3bbe85a04977 service nova] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:09.143307 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d1eb9499-2441-4d39-8167-adc2bb643d7f req-bcb29194-ca5e-4686-b3f3-3bbe85a04977 service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] No waiting events found dispatching network-vif-plugged-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:42:09.143307 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-d1eb9499-2441-4d39-8167-adc2bb643d7f req-bcb29194-ca5e-4686-b3f3-3bbe85a04977 service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Received unexpected event network-vif-plugged-62e285cd-c2d8-4883-a400-d57367b20980 for instance with vm_state active and task_state None. Jun 25 04:42:09.182807 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:42:09.183161 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:42:09.459267 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:09.463155 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:42:09.463702 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] VM Resumed (Lifecycle Event) Jun 25 04:42:09.501171 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Took 22.54 seconds to build instance. Jun 25 04:42:09.686996 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:42:09.825190 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Successfully created port: 789bf2ca-f86e-403a-88a3-0103291a84df {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:42:09.841360 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:09.967140 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:09.973518 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:42:10.003161 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b76b704a-66a7-42c5-ac7a-ef095e43626a tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 24.049s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:10.021065 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Start building block device mappings for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 25 04:42:10.197981 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.704s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:10.198490 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:42:10.422880 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Successfully created port: aa227a29-8d0b-49f2-a71e-233ba6d38b79 {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:42:10.461338 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:10.527266 np0000003587 nova-compute[98952]: INFO nova.virt.block_device [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Booting with volume 1a3ea2da-7efc-4b95-830c-6c043906aa00 at /dev/vda Jun 25 04:42:10.600370 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.80', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003587', 'execute': None}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:42:10.614581 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.scaleio [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98952) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 25 04:42:10.645130 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Running cmd (subprocess): nvme version {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:10.679187 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] 'nvme version' failed. Not Retrying. {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 04:42:10.680175 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] nvme not present on system {{(pid=98952) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 25 04:42:10.692829 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98952) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 25 04:42:10.695808 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.lightos [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Current host hostNQN and IP(s) are ['10.4.3.80', 'fe80::f816:3eff:feea:dfe4', '192.168.40.6', 'fe80::f816:3eff:fe4f:7c42', '192.168.50.6', 'fe80::f816:3eff:fe6c:e6a6', '192.168.10.6', 'fe80::f816:3eff:fe17:d749', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::b035:28ff:fe70:6f4a', 'fe80::fc16:3eff:fe8c:f883', 'fe80::483f:f2ff:fe48:75ca', 'fe80::fc16:3eff:fe5d:a0ff', 'fe80::b819:93ff:fef3:f5f3', 'fe80::fc16:3eff:fe78:7ac8', 'fe80::1038:1dff:fe1c:d44b', 'fe80::fc16:3eff:feb0:e88f', 'fe80::5c81:6cff:fe82:5221', 'fe80::fc16:3eff:fe3a:4858', 'fe80::fc16:3eff:fee6:e022'] Jun 25 04:42:10.695808 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 25 04:42:10.696138 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] LIGHTOS: no hostnqn found. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 25 04:42:10.696364 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.80', 'host': 'np0000003587', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c81886224652', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a1feb13-40e2-4ac6-989e-b08a6fc0f283', 'nvme_native_multipath': False} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:42:10.696875 np0000003587 nova-compute[98952]: DEBUG nova.virt.block_device [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Updating existing volume attachment record: 9e69f33b-39f2-43db-9923-5bce949c3d5b {{(pid=98952) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 25 04:42:10.714952 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:42:10.715270 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:42:10.715627 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:10.716021 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:10.850278 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '947bde0e827c45f5bab008d094816d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284d191aa82f453cabcfd18172f74099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:42:11.113679 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Successfully created port: 40295919-4c2c-4e1e-be95-73e18d612ce4 {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:42:11.215086 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 25 04:42:11.689184 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Successfully created port: 189c1769-d72c-42d1-9e3e-1e978c8bf93f {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:42:11.723811 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Start building block device mappings for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 25 04:42:11.787495 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Rescuing Jun 25 04:42:11.788785 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "refresh_cache-9aa3370c-9525-460d-b6fc-40a6461bd725" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:11.788785 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquired lock "refresh_cache-9aa3370c-9525-460d-b6fc-40a6461bd725" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:42:11.788942 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:42:12.292242 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:12.369492 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Successfully created port: f002d56c-77f0-4fb0-9501-751106b08f89 {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:42:12.386167 np0000003587 nova-compute[98952]: INFO nova.virt.block_device [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Booting with volume e0002b7f-67b9-4af1-82f9-7e5e8a55faaf at /dev/vdb Jun 25 04:42:12.477921 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.80', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003587', 'execute': None}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:42:12.486603 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Successfully updated port: 189c1769-d72c-42d1-9e3e-1e978c8bf93f {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:42:12.496071 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.scaleio [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98952) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 25 04:42:12.537004 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Running cmd (subprocess): nvme version {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:12.568633 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-9b02337e-68b7-4ce7-9754-b667966a7a1c req-42793687-9dca-461d-aa63-28477526b424 service nova] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Received event network-changed-189c1769-d72c-42d1-9e3e-1e978c8bf93f {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:12.569021 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-9b02337e-68b7-4ce7-9754-b667966a7a1c req-42793687-9dca-461d-aa63-28477526b424 service nova] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Refreshing instance network info cache due to event network-changed-189c1769-d72c-42d1-9e3e-1e978c8bf93f. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:42:12.569316 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-9b02337e-68b7-4ce7-9754-b667966a7a1c req-42793687-9dca-461d-aa63-28477526b424 service nova] Acquiring lock "refresh_cache-19180a23-a7e0-4354-b9f4-9ca57062fc06" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:12.569433 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-9b02337e-68b7-4ce7-9754-b667966a7a1c req-42793687-9dca-461d-aa63-28477526b424 service nova] Acquired lock "refresh_cache-19180a23-a7e0-4354-b9f4-9ca57062fc06" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:42:12.569666 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-9b02337e-68b7-4ce7-9754-b667966a7a1c req-42793687-9dca-461d-aa63-28477526b424 service nova] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Refreshing network info cache for port 189c1769-d72c-42d1-9e3e-1e978c8bf93f {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:42:12.575637 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] 'nvme version' failed. Not Retrying. {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 04:42:12.576204 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] nvme not present on system {{(pid=98952) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 25 04:42:12.593498 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98952) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 25 04:42:12.594294 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.lightos [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Current host hostNQN and IP(s) are ['10.4.3.80', 'fe80::f816:3eff:feea:dfe4', '192.168.40.6', 'fe80::f816:3eff:fe4f:7c42', '192.168.50.6', 'fe80::f816:3eff:fe6c:e6a6', '192.168.10.6', 'fe80::f816:3eff:fe17:d749', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::b035:28ff:fe70:6f4a', 'fe80::fc16:3eff:fe8c:f883', 'fe80::483f:f2ff:fe48:75ca', 'fe80::fc16:3eff:fe5d:a0ff', 'fe80::b819:93ff:fef3:f5f3', 'fe80::fc16:3eff:fe78:7ac8', 'fe80::1038:1dff:fe1c:d44b', 'fe80::fc16:3eff:feb0:e88f', 'fe80::5c81:6cff:fe82:5221', 'fe80::fc16:3eff:fe3a:4858', 'fe80::fc16:3eff:fee6:e022'] Jun 25 04:42:12.594507 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 25 04:42:12.594507 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] LIGHTOS: no hostnqn found. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 25 04:42:12.595287 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.80', 'host': 'np0000003587', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c81886224652', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a1feb13-40e2-4ac6-989e-b08a6fc0f283', 'nvme_native_multipath': False} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:42:12.597709 np0000003587 nova-compute[98952]: DEBUG nova.virt.block_device [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Updating existing volume attachment record: a8c64e6b-3090-4c15-8306-ed14442b5e7b {{(pid=98952) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 25 04:42:12.733319 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Start spawning the instance on the hypervisor. {{(pid=98952) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 25 04:42:12.743328 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Creating instance directory {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 25 04:42:12.743954 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Creating image(s) Jun 25 04:42:12.744809 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "/opt/stack/data/nova/instances/19180a23-a7e0-4354-b9f4-9ca57062fc06/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:12.745272 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "/opt/stack/data/nova/instances/19180a23-a7e0-4354-b9f4-9ca57062fc06/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:12.745950 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "/opt/stack/data/nova/instances/19180a23-a7e0-4354-b9f4-9ca57062fc06/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:12.746923 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:42:12.753032 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:42:12.755182 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:12.862304 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.107s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:12.863042 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:12.864357 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:12.864934 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:42:12.871046 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:42:12.873003 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:12.971792 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.098s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:12.972490 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/19180a23-a7e0-4354-b9f4-9ca57062fc06/disk 1073741824 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:12.999637 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:13.006256 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "refresh_cache-19180a23-a7e0-4354-b9f4-9ca57062fc06" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:13.037069 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/19180a23-a7e0-4354-b9f4-9ca57062fc06/disk 1073741824" returned: 0 in 0.064s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:13.037886 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.173s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:13.038110 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:13.085662 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:13.087523 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-9b02337e-68b7-4ce7-9754-b667966a7a1c req-42793687-9dca-461d-aa63-28477526b424 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:13.156583 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.116s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:13.156583 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Checking if we can resize image /opt/stack/data/nova/instances/19180a23-a7e0-4354-b9f4-9ca57062fc06/disk. size=1073741824 {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 25 04:42:13.156583 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19180a23-a7e0-4354-b9f4-9ca57062fc06/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:13.207175 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-9b02337e-68b7-4ce7-9754-b667966a7a1c req-42793687-9dca-461d-aa63-28477526b424 service nova] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:42:13.268290 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19180a23-a7e0-4354-b9f4-9ca57062fc06/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:13.269461 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Cannot resize image /opt/stack/data/nova/instances/19180a23-a7e0-4354-b9f4-9ca57062fc06/disk to a smaller size. {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 25 04:42:13.269934 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Created local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 25 04:42:13.270140 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Ensure instance console log exists: /opt/stack/data/nova/instances/19180a23-a7e0-4354-b9f4-9ca57062fc06/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:42:13.272105 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:13.272105 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:13.272105 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:13.331293 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Updating instance_info_cache with network_info: [{"id": "62e285cd-c2d8-4883-a400-d57367b20980", "address": "fa:16:3e:e6:e0:22", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e285cd-c2", "ovs_interfaceid": "62e285cd-c2d8-4883-a400-d57367b20980", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:13.685322 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-9b02337e-68b7-4ce7-9754-b667966a7a1c req-42793687-9dca-461d-aa63-28477526b424 service nova] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:13.837683 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Releasing lock "refresh_cache-9aa3370c-9525-460d-b6fc-40a6461bd725" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:42:13.998142 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:14.187734 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-9b02337e-68b7-4ce7-9754-b667966a7a1c req-42793687-9dca-461d-aa63-28477526b424 service nova] Releasing lock "refresh_cache-19180a23-a7e0-4354-b9f4-9ca57062fc06" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:42:14.188676 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquired lock "refresh_cache-19180a23-a7e0-4354-b9f4-9ca57062fc06" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:42:14.188676 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:42:14.301147 np0000003587 nova-compute[98952]: INFO nova.virt.block_device [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Booting with volume cc7be47d-8d0a-4286-86d2-621b59df6075 at /dev/vdc Jun 25 04:42:14.333170 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Successfully updated port: e12da27e-2953-4784-80b6-5f7204f4e399 {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:42:14.357170 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.80', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003587', 'execute': None}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:42:14.370985 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.scaleio [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98952) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 25 04:42:14.393768 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2ccc6650-608d-452d-b8c9-e16aa5b529f1 req-0c1fd167-73a0-4fe2-aaf0-076f86fb02cd service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-changed-e12da27e-2953-4784-80b6-5f7204f4e399 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:14.393768 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2ccc6650-608d-452d-b8c9-e16aa5b529f1 req-0c1fd167-73a0-4fe2-aaf0-076f86fb02cd service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Refreshing instance network info cache due to event network-changed-e12da27e-2953-4784-80b6-5f7204f4e399. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:42:14.393768 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2ccc6650-608d-452d-b8c9-e16aa5b529f1 req-0c1fd167-73a0-4fe2-aaf0-076f86fb02cd service nova] Acquiring lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:14.393994 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2ccc6650-608d-452d-b8c9-e16aa5b529f1 req-0c1fd167-73a0-4fe2-aaf0-076f86fb02cd service nova] Acquired lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:42:14.393994 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-2ccc6650-608d-452d-b8c9-e16aa5b529f1 req-0c1fd167-73a0-4fe2-aaf0-076f86fb02cd service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Refreshing network info cache for port e12da27e-2953-4784-80b6-5f7204f4e399 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:42:14.398430 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Running cmd (subprocess): nvme version {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:14.427413 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] 'nvme version' failed. Not Retrying. {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 04:42:14.427827 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] nvme not present on system {{(pid=98952) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 25 04:42:14.439208 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98952) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 25 04:42:14.440250 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.lightos [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Current host hostNQN and IP(s) are ['10.4.3.80', 'fe80::f816:3eff:feea:dfe4', '192.168.40.6', 'fe80::f816:3eff:fe4f:7c42', '192.168.50.6', 'fe80::f816:3eff:fe6c:e6a6', '192.168.10.6', 'fe80::f816:3eff:fe17:d749', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::b035:28ff:fe70:6f4a', 'fe80::fc16:3eff:fe8c:f883', 'fe80::483f:f2ff:fe48:75ca', 'fe80::fc16:3eff:fe5d:a0ff', 'fe80::b819:93ff:fef3:f5f3', 'fe80::fc16:3eff:fe78:7ac8', 'fe80::1038:1dff:fe1c:d44b', 'fe80::fc16:3eff:feb0:e88f', 'fe80::5c81:6cff:fe82:5221', 'fe80::fc16:3eff:fe3a:4858', 'fe80::fc16:3eff:fee6:e022'] Jun 25 04:42:14.440484 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 25 04:42:14.441162 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] LIGHTOS: no hostnqn found. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 25 04:42:14.441162 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.80', 'host': 'np0000003587', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c81886224652', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a1feb13-40e2-4ac6-989e-b08a6fc0f283', 'nvme_native_multipath': False} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:42:14.441297 np0000003587 nova-compute[98952]: DEBUG nova.virt.block_device [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Updating existing volume attachment record: 3aceea7e-9cba-4682-8830-2c86098781a3 {{(pid=98952) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 25 04:42:14.777873 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:42:14.845929 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:14.897359 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-2ccc6650-608d-452d-b8c9-e16aa5b529f1 req-0c1fd167-73a0-4fe2-aaf0-076f86fb02cd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:15.004543 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:15.040435 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-2ccc6650-608d-452d-b8c9-e16aa5b529f1 req-0c1fd167-73a0-4fe2-aaf0-076f86fb02cd service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:42:15.195857 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Updating instance_info_cache with network_info: [{"id": "189c1769-d72c-42d1-9e3e-1e978c8bf93f", "address": "fa:16:3e:4f:40:83", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap189c1769-d7", "ovs_interfaceid": "189c1769-d72c-42d1-9e3e-1e978c8bf93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:15.266630 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-2ccc6650-608d-452d-b8c9-e16aa5b529f1 req-0c1fd167-73a0-4fe2-aaf0-076f86fb02cd service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:15.522808 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:15.532788 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:15.550452 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:15.701495 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Releasing lock "refresh_cache-19180a23-a7e0-4354-b9f4-9ca57062fc06" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:42:15.701495 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Instance network_info: |[{"id": "189c1769-d72c-42d1-9e3e-1e978c8bf93f", "address": "fa:16:3e:4f:40:83", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap189c1769-d7", "ovs_interfaceid": "189c1769-d72c-42d1-9e3e-1e978c8bf93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 25 04:42:15.711491 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Start _get_guest_xml network_info=[{"id": "189c1769-d72c-42d1-9e3e-1e978c8bf93f", "address": "fa:16:3e:4f:40:83", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap189c1769-d7", "ovs_interfaceid": "189c1769-d72c-42d1-9e3e-1e978c8bf93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '4ecaf199-c1b9-4ce3-869c-178c170c1662'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:42:15.730423 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:42:15.730423 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='19180a23-a7e0-4354-b9f4-9ca57062fc06'), owner=OwnerMeta(userid='947bde0e827c45f5bab008d094816d8c', username='tempest-AttachVolumeMultiAttachTest-1256899935-project-member', projectid='284d191aa82f453cabcfd18172f74099', projectname='tempest-AttachVolumeMultiAttachTest-1256899935'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "189c1769-d72c-42d1-9e3e-1e978c8bf93f", "address": "fa:16:3e:4f:40:83", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap189c1769-d7", "ovs_interfaceid": "189c1769-d72c-42d1-9e3e-1e978c8bf93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362535.7290475) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:42:15.732515 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:42:15.733184 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:42:15.735378 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:42:15.735635 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:42:15.737089 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:42:15.737893 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:42:15.737893 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:42:15.737893 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:42:15.738384 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:42:15.739568 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:42:15.739568 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:42:15.739568 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:42:15.739784 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:42:15.740681 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:42:15.740681 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:42:15.740681 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:42:15.759676 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:42:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='multiattach-server-1',id=9,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV/p3ZeuUk+pDtRyjEqB6LGacp/8M+rMj60nbQpQu7IIRoy9lFRhD1vsgSIFDZ+PjS4ytFpGVQZ3frW+0uH/J+qnA92sFXepo+od7tCOydqRChW2tpsraqZi+iIk6G08A==',key_name='tempest-keypair-462979399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='284d191aa82f453cabcfd18172f74099',ramdisk_id='',reservation_id='r-ar44spxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1256899935',owner_user_name='tempest-AttachVolumeMultiAttachTest-1256899935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='947bde0e827c45f5bab008d094816d8c',uuid=19180a23-a7e0-4354-b9f4-9ca57062fc06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "189c1769-d72c-42d1-9e3e-1e978c8bf93f", "address": "fa:16:3e:4f:40:83", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap189c1769-d7", "ovs_interfaceid": "189c1769-d72c-42d1-9e3e-1e978c8bf93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:42:15.759676 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converting VIF {"id": "189c1769-d72c-42d1-9e3e-1e978c8bf93f", "address": "fa:16:3e:4f:40:83", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap189c1769-d7", "ovs_interfaceid": "189c1769-d72c-42d1-9e3e-1e978c8bf93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:42:15.760454 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:40:83,bridge_name='br-int',has_traffic_filtering=True,id=189c1769-d72c-42d1-9e3e-1e978c8bf93f,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189c1769-d7') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:42:15.760886 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lazy-loading 'pci_devices' on Instance uuid 19180a23-a7e0-4354-b9f4-9ca57062fc06 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:15.771189 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2ccc6650-608d-452d-b8c9-e16aa5b529f1 req-0c1fd167-73a0-4fe2-aaf0-076f86fb02cd service nova] Releasing lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:42:15.798278 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:15.805955 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:15.841384 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:15.847715 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Successfully updated port: 7e8846aa-559c-48a1-bf9a-ab431fd380ed {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:42:15.853051 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:15.873818 np0000003587 nova-compute[98952]: DEBUG nova.utils [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Queued Task(fn=>, remaining_delay=14.999590639999951 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:42:15.874061 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.999260879000076 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:42:15.874154 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.999153970999942 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:42:15.881948 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Instance destroyed successfully. Jun 25 04:42:15.884466 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'numa_topology' on Instance uuid 9aa3370c-9525-460d-b6fc-40a6461bd725 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:15.931018 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-3fb156ad-2070-4934-8a95-34b8a3474728 req-995eb407-c8fc-44b5-9c52-46effee644b9 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-changed-7e8846aa-559c-48a1-bf9a-ab431fd380ed {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:15.931661 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-3fb156ad-2070-4934-8a95-34b8a3474728 req-995eb407-c8fc-44b5-9c52-46effee644b9 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Refreshing instance network info cache due to event network-changed-7e8846aa-559c-48a1-bf9a-ab431fd380ed. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:42:15.931661 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-3fb156ad-2070-4934-8a95-34b8a3474728 req-995eb407-c8fc-44b5-9c52-46effee644b9 service nova] Acquiring lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:15.932071 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-3fb156ad-2070-4934-8a95-34b8a3474728 req-995eb407-c8fc-44b5-9c52-46effee644b9 service nova] Acquired lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:42:15.932071 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-3fb156ad-2070-4934-8a95-34b8a3474728 req-995eb407-c8fc-44b5-9c52-46effee644b9 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Refreshing network info cache for port 7e8846aa-559c-48a1-bf9a-ab431fd380ed {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] End _get_guest_xml xml= Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: 19180a23-a7e0-4354-b9f4-9ca57062fc06 Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: instance-00000009 Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: 196608 Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: multiattach-server-1 Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: 2026-06-25 04:42:15 Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: 192 Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: 0 Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: 0 Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: True Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: bare Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: 0 Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: virtio Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: tempest-AttachVolumeMultiAttachTest-1256899935-project-member Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: tempest-AttachVolumeMultiAttachTest-1256899935 Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: 19180a23-a7e0-4354-b9f4-9ca57062fc06 Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: 19180a23-a7e0-4354-b9f4-9ca57062fc06 Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: hvm Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: 128 Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: Jun 25 04:42:16.266371 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:42:16.270453 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Preparing to wait for external event network-vif-plugged-189c1769-d72c-42d1-9e3e-1e978c8bf93f {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:42:16.270453 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "19180a23-a7e0-4354-b9f4-9ca57062fc06-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:16.270453 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "19180a23-a7e0-4354-b9f4-9ca57062fc06-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:16.270453 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "19180a23-a7e0-4354-b9f4-9ca57062fc06-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:16.270453 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:42:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='multiattach-server-1',id=9,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV/p3ZeuUk+pDtRyjEqB6LGacp/8M+rMj60nbQpQu7IIRoy9lFRhD1vsgSIFDZ+PjS4ytFpGVQZ3frW+0uH/J+qnA92sFXepo+od7tCOydqRChW2tpsraqZi+iIk6G08A==',key_name='tempest-keypair-462979399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='284d191aa82f453cabcfd18172f74099',ramdisk_id='',reservation_id='r-ar44spxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1256899935',owner_user_name='tempest-AttachVolumeMultiAttachTest-1256899935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='947bde0e827c45f5bab008d094816d8c',uuid=19180a23-a7e0-4354-b9f4-9ca57062fc06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "189c1769-d72c-42d1-9e3e-1e978c8bf93f", "address": "fa:16:3e:4f:40:83", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap189c1769-d7", "ovs_interfaceid": "189c1769-d72c-42d1-9e3e-1e978c8bf93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:42:16.270794 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converting VIF {"id": "189c1769-d72c-42d1-9e3e-1e978c8bf93f", "address": "fa:16:3e:4f:40:83", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap189c1769-d7", "ovs_interfaceid": "189c1769-d72c-42d1-9e3e-1e978c8bf93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:42:16.270794 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:40:83,bridge_name='br-int',has_traffic_filtering=True,id=189c1769-d72c-42d1-9e3e-1e978c8bf93f,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189c1769-d7') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:42:16.270794 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:40:83,bridge_name='br-int',has_traffic_filtering=True,id=189c1769-d72c-42d1-9e3e-1e978c8bf93f,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189c1769-d7') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:42:16.271062 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:16.271720 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:16.271720 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:42:16.273781 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:16.273943 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ef48809-82b0-5014-840d-85cc0dfa5c8e', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:16.276294 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:16.277006 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:16.286269 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:16.289904 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:16.289904 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap189c1769-d7, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:16.290915 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap189c1769-d7, col_values=(('qos', UUID('72441f48-46f3-4a09-b342-8807e0c86356')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:16.291416 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap189c1769-d7, col_values=(('external_ids', {'iface-id': '189c1769-d72c-42d1-9e3e-1e978c8bf93f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:40:83', 'vm-uuid': '19180a23-a7e0-4354-b9f4-9ca57062fc06'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:16.294037 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:16.295764 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:16.309839 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:16.311278 np0000003587 nova-compute[98952]: INFO os_vif [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:40:83,bridge_name='br-int',has_traffic_filtering=True,id=189c1769-d72c-42d1-9e3e-1e978c8bf93f,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189c1769-d7') Jun 25 04:42:16.392137 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Attempting a stable device rescue Jun 25 04:42:16.437123 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-3fb156ad-2070-4934-8a95-34b8a3474728 req-995eb407-c8fc-44b5-9c52-46effee644b9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:16.479672 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-84b0e510-0452-4ae5-9398-23c0d697c41e req-82237904-32be-480f-a5c3-26e8e961cbdd service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Received event network-vif-unplugged-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:16.479672 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-84b0e510-0452-4ae5-9398-23c0d697c41e req-82237904-32be-480f-a5c3-26e8e961cbdd service nova] Acquiring lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:16.479922 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-84b0e510-0452-4ae5-9398-23c0d697c41e req-82237904-32be-480f-a5c3-26e8e961cbdd service nova] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:16.479922 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-84b0e510-0452-4ae5-9398-23c0d697c41e req-82237904-32be-480f-a5c3-26e8e961cbdd service nova] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:16.480523 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-84b0e510-0452-4ae5-9398-23c0d697c41e req-82237904-32be-480f-a5c3-26e8e961cbdd service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] No waiting events found dispatching network-vif-unplugged-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:42:16.480523 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-84b0e510-0452-4ae5-9398-23c0d697c41e req-82237904-32be-480f-a5c3-26e8e961cbdd service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Received unexpected event network-vif-unplugged-62e285cd-c2d8-4883-a400-d57367b20980 for instance with vm_state active and task_state rescuing. Jun 25 04:42:16.480523 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-84b0e510-0452-4ae5-9398-23c0d697c41e req-82237904-32be-480f-a5c3-26e8e961cbdd service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Received event network-vif-unplugged-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:16.480523 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-84b0e510-0452-4ae5-9398-23c0d697c41e req-82237904-32be-480f-a5c3-26e8e961cbdd service nova] Acquiring lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:16.480812 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-84b0e510-0452-4ae5-9398-23c0d697c41e req-82237904-32be-480f-a5c3-26e8e961cbdd service nova] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:16.480812 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-84b0e510-0452-4ae5-9398-23c0d697c41e req-82237904-32be-480f-a5c3-26e8e961cbdd service nova] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:16.481002 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-84b0e510-0452-4ae5-9398-23c0d697c41e req-82237904-32be-480f-a5c3-26e8e961cbdd service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] No waiting events found dispatching network-vif-unplugged-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:42:16.481190 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-84b0e510-0452-4ae5-9398-23c0d697c41e req-82237904-32be-480f-a5c3-26e8e961cbdd service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Received unexpected event network-vif-unplugged-62e285cd-c2d8-4883-a400-d57367b20980 for instance with vm_state active and task_state rescuing. Jun 25 04:42:16.518107 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98952) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}} Jun 25 04:42:16.521876 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Instance directory exists: not creating {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}} Jun 25 04:42:16.522028 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Creating image(s) Jun 25 04:42:16.522736 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "/opt/stack/data/nova/instances/9aa3370c-9525-460d-b6fc-40a6461bd725/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:16.523039 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "/opt/stack/data/nova/instances/9aa3370c-9525-460d-b6fc-40a6461bd725/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:16.523902 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "/opt/stack/data/nova/instances/9aa3370c-9525-460d-b6fc-40a6461bd725/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:16.524096 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9aa3370c-9525-460d-b6fc-40a6461bd725 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:16.552946 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-3fb156ad-2070-4934-8a95-34b8a3474728 req-995eb407-c8fc-44b5-9c52-46effee644b9 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:42:16.656650 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Start spawning the instance on the hypervisor. {{(pid=98952) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 25 04:42:16.658035 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Creating instance directory {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 25 04:42:16.658328 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Creating image(s) Jun 25 04:42:16.658817 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Did not create local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 25 04:42:16.659064 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Ensure instance console log exists: /opt/stack/data/nova/instances/9c033870-f167-4235-86ff-98005452a16c/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:42:16.659900 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:16.659900 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:16.660116 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:16.793211 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-3fb156ad-2070-4934-8a95-34b8a3474728 req-995eb407-c8fc-44b5-9c52-46effee644b9 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:17.027301 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Object Instance<9aa3370c-9525-460d-b6fc-40a6461bd725> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:42:17.027524 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "ad28f7cf7b458f0a0ead80df67bddb1c552e56d5" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:17.028133 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "ad28f7cf7b458f0a0ead80df67bddb1c552e56d5" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:17.210989 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Successfully updated port: 4d1f24c3-d7a8-450a-92d5-0e807355b791 {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:42:17.295671 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-3fb156ad-2070-4934-8a95-34b8a3474728 req-995eb407-c8fc-44b5-9c52-46effee644b9 service nova] Releasing lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:42:17.394621 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Acquiring lock "5e52bd75-8566-4472-8147-99655013bc83" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:17.394844 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "5e52bd75-8566-4472-8147-99655013bc83" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:17.849985 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:42:17.849985 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:42:17.849985 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No VIF found with MAC fa:16:3e:4f:40:83, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:42:17.850620 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Using config drive Jun 25 04:42:17.899302 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lazy-loading 'flavor' on Instance uuid 5e52bd75-8566-4472-8147-99655013bc83 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:18.232997 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:42:18.238378 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:42:18.238378 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad28f7cf7b458f0a0ead80df67bddb1c552e56d5.part --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:18.327223 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad28f7cf7b458f0a0ead80df67bddb1c552e56d5.part --force-share --output=json" returned: 0 in 0.089s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:18.327788 np0000003587 nova-compute[98952]: DEBUG nova.virt.images [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] 5edfaadf-de24-4e90-83ff-358eaee51cf8 was qcow2, converting to raw {{(pid=98952) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 25 04:42:18.329186 np0000003587 nova-compute[98952]: DEBUG nova.privsep.utils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98952) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 25 04:42:18.329571 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad28f7cf7b458f0a0ead80df67bddb1c552e56d5.part /opt/stack/data/nova/instances/_base/ad28f7cf7b458f0a0ead80df67bddb1c552e56d5.converted {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:18.364476 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:18.464829 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad28f7cf7b458f0a0ead80df67bddb1c552e56d5.part /opt/stack/data/nova/instances/_base/ad28f7cf7b458f0a0ead80df67bddb1c552e56d5.converted" returned: 0 in 0.133s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:18.472955 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad28f7cf7b458f0a0ead80df67bddb1c552e56d5.converted --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:18.496904 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:18.576919 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Successfully updated port: 789bf2ca-f86e-403a-88a3-0103291a84df {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:42:18.577608 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad28f7cf7b458f0a0ead80df67bddb1c552e56d5.converted --force-share --output=json" returned: 0 in 0.105s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:18.578286 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "ad28f7cf7b458f0a0ead80df67bddb1c552e56d5" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.550s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:18.578724 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:42:18.584259 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:42:18.588818 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "ad28f7cf7b458f0a0ead80df67bddb1c552e56d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:18.589462 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "ad28f7cf7b458f0a0ead80df67bddb1c552e56d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:18.589928 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:42:18.597075 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-320a4e5f-b1d7-4cb8-832c-2023d705a370 req-330d2d0f-0188-4026-aa98-0bfb2ceb8077 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-changed-4d1f24c3-d7a8-450a-92d5-0e807355b791 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:18.597643 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-320a4e5f-b1d7-4cb8-832c-2023d705a370 req-330d2d0f-0188-4026-aa98-0bfb2ceb8077 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Refreshing instance network info cache due to event network-changed-4d1f24c3-d7a8-450a-92d5-0e807355b791. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:42:18.598795 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:42:18.599272 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-320a4e5f-b1d7-4cb8-832c-2023d705a370 req-330d2d0f-0188-4026-aa98-0bfb2ceb8077 service nova] Acquiring lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:18.600247 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad28f7cf7b458f0a0ead80df67bddb1c552e56d5 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:18.600451 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-320a4e5f-b1d7-4cb8-832c-2023d705a370 req-330d2d0f-0188-4026-aa98-0bfb2ceb8077 service nova] Acquired lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:42:18.600788 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-320a4e5f-b1d7-4cb8-832c-2023d705a370 req-330d2d0f-0188-4026-aa98-0bfb2ceb8077 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Refreshing network info cache for port 4d1f24c3-d7a8-450a-92d5-0e807355b791 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:42:18.637109 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-ab83cf93-cba9-413e-bea2-77eedc4ab4b6 req-55a985d3-f08b-4772-acd0-96fd10a8b5e3 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-changed-789bf2ca-f86e-403a-88a3-0103291a84df {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:18.637369 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-ab83cf93-cba9-413e-bea2-77eedc4ab4b6 req-55a985d3-f08b-4772-acd0-96fd10a8b5e3 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Refreshing instance network info cache due to event network-changed-789bf2ca-f86e-403a-88a3-0103291a84df. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:42:18.641140 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ab83cf93-cba9-413e-bea2-77eedc4ab4b6 req-55a985d3-f08b-4772-acd0-96fd10a8b5e3 service nova] Acquiring lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:18.661300 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Creating config drive at /opt/stack/data/nova/instances/19180a23-a7e0-4354-b9f4-9ca57062fc06/disk.config Jun 25 04:42:18.666750 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/19180a23-a7e0-4354-b9f4-9ca57062fc06/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkbq90jbe {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:18.695148 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad28f7cf7b458f0a0ead80df67bddb1c552e56d5 --force-share --output=json" returned: 0 in 0.094s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:18.696149 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad28f7cf7b458f0a0ead80df67bddb1c552e56d5,backing_fmt=raw /opt/stack/data/nova/instances/9aa3370c-9525-460d-b6fc-40a6461bd725/disk.rescue {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:18.717052 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/19180a23-a7e0-4354-b9f4-9ca57062fc06/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkbq90jbe" returned: 0 in 0.050s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:18.743322 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad28f7cf7b458f0a0ead80df67bddb1c552e56d5,backing_fmt=raw /opt/stack/data/nova/instances/9aa3370c-9525-460d-b6fc-40a6461bd725/disk.rescue" returned: 0 in 0.047s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:18.744239 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "ad28f7cf7b458f0a0ead80df67bddb1c552e56d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.155s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:18.744758 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'migration_context' on Instance uuid 9aa3370c-9525-460d-b6fc-40a6461bd725 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:18.919500 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "5e52bd75-8566-4472-8147-99655013bc83" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.524s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:19.118442 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-320a4e5f-b1d7-4cb8-832c-2023d705a370 req-330d2d0f-0188-4026-aa98-0bfb2ceb8077 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:19.224672 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-320a4e5f-b1d7-4cb8-832c-2023d705a370 req-330d2d0f-0188-4026-aa98-0bfb2ceb8077 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:42:19.249251 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Object Instance<9aa3370c-9525-460d-b6fc-40a6461bd725> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:42:19.249474 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Created local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 25 04:42:19.250508 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Start _get_guest_xml network_info=[{"id": "62e285cd-c2d8-4883-a400-d57367b20980", "address": "fa:16:3e:e6:e0:22", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "vif_mac": "fa:16:3e:e6:e0:22"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e285cd-c2", "ovs_interfaceid": "62e285cd-c2d8-4883-a400-d57367b20980", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue={'image_id': '5edfaadf-de24-4e90-83ff-358eaee51cf8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, 'status': 'reserved', 'instance': '9aa3370c-9525-460d-b6fc-40a6461bd725', 'attached_at': '', 'detached_at': '', 'volume_id': '9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'serial': '9ed7fd1c-6933-4549-8acc-d425cd2d10a6'}, 'attachment_id': '310ec554-11e0-4d4a-9a26-9f655dfc1dcb', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:42:19.250737 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'resources' on Instance uuid 9aa3370c-9525-460d-b6fc-40a6461bd725 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:19.294839 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:19.329595 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:19.331298 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:19.461529 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:19.497238 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-320a4e5f-b1d7-4cb8-832c-2023d705a370 req-330d2d0f-0188-4026-aa98-0bfb2ceb8077 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:19.533273 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:19.541973 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:19.757103 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Object Instance<9aa3370c-9525-460d-b6fc-40a6461bd725> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:42:19.761518 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:42:19.763526 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1691757098', uuid='9aa3370c-9525-460d-b6fc-40a6461bd725'), owner=OwnerMeta(userid='27ebe4b23b624995a52b9313ff9e318a', username='tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member', projectid='a5d52ed3b8de460eb65a8fb4ad1b015d', projectname='tempest-ServerBootFromVolumeStableRescueTest-6878904'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "62e285cd-c2d8-4883-a400-d57367b20980", "address": "fa:16:3e:e6:e0:22", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "vif_mac": "fa:16:3e:e6:e0:22"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e285cd-c2", "ovs_interfaceid": "62e285cd-c2d8-4883-a400-d57367b20980", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362539.7629466) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:42:19.770312 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:42:19.771086 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:42:19.773855 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:42:19.774105 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:42:19.775455 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:42:19.775519 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:42:19.777194 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:42:19.777194 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:42:19.777194 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:42:19.777194 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:42:19.779707 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:42:19.780260 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:42:19.780915 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:42:19.780915 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:42:19.780915 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:42:19.781744 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:42:19.783648 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9aa3370c-9525-460d-b6fc-40a6461bd725 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:19.846644 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:20.001444 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-320a4e5f-b1d7-4cb8-832c-2023d705a370 req-330d2d0f-0188-4026-aa98-0bfb2ceb8077 service nova] Releasing lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:42:20.001977 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ab83cf93-cba9-413e-bea2-77eedc4ab4b6 req-55a985d3-f08b-4772-acd0-96fd10a8b5e3 service nova] Acquired lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:42:20.002461 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-ab83cf93-cba9-413e-bea2-77eedc4ab4b6 req-55a985d3-f08b-4772-acd0-96fd10a8b5e3 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Refreshing network info cache for port 789bf2ca-f86e-403a-88a3-0103291a84df {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:42:20.289928 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Object Instance<9aa3370c-9525-460d-b6fc-40a6461bd725> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:42:20.300353 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aa3370c-9525-460d-b6fc-40a6461bd725/disk.config --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:20.347930 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Successfully updated port: aa227a29-8d0b-49f2-a71e-233ba6d38b79 {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:42:20.377931 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9aa3370c-9525-460d-b6fc-40a6461bd725/disk.config --force-share --output=json" returned: 0 in 0.077s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:20.378476 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "/opt/stack/data/nova/instances/9aa3370c-9525-460d-b6fc-40a6461bd725/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:20.378782 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "/opt/stack/data/nova/instances/9aa3370c-9525-460d-b6fc-40a6461bd725/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:20.380057 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "/opt/stack/data/nova/instances/9aa3370c-9525-460d-b6fc-40a6461bd725/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:20.380057 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Calling os-brick to attach iSCSI Volume {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 25 04:42:20.380380 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:42:20.380538 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:20.380922 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:20.381156 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=98952) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 25 04:42:20.399307 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:20.400154 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:20.400928 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:42:20.401863 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:20.404382 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:20.404382 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.startup = automatic Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.scan = manual Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.40.100 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:42:20.417247 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:20.423010 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Acquiring lock "54721bc9-c45c-4cb1-9910-f47334e84cd2" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:20.423162 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Lock "54721bc9-c45c-4cb1-9910-f47334e84cd2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.startup = automatic Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.scan = manual Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.50.100 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:42:20.429589 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:20.439671 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:20.447288 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:20.454781 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:20.454781 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:20.454781 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:20.454781 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:20.454781 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:20.455051 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:20.455051 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:20.455051 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:20.455051 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:20.455051 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:20.455269 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.055s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:20.455404 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Connected to 192.168.40.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:42:20.456380 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] HCTL ('9', '0', '0', 0) found on session 5 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:42:20.456537 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:42:20.465290 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:20.465290 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:20.465290 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:20.465290 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:20.465290 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:20.465464 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:20.465464 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:20.465464 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:20.465464 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:20.465464 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:20.465775 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.063s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:20.465911 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Connected to 192.168.50.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:42:20.466388 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] HCTL ('10', '0', '0', 0) found on session 6 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:42:20.466521 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:42:20.467287 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Searching for a device in session 5 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:42:20.467516 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:42:20.477589 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Searching for a device in session 6 and hctl ('10', '0', '0', 0) yield: sde {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:42:20.477801 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:42:20.507579 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-ab83cf93-cba9-413e-bea2-77eedc4ab4b6 req-55a985d3-f08b-4772-acd0-96fd10a8b5e3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:20.521019 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:42:20.521129 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] VM Started (Lifecycle Event) Jun 25 04:42:20.610570 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-ab83cf93-cba9-413e-bea2-77eedc4ab4b6 req-55a985d3-f08b-4772-acd0-96fd10a8b5e3 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:42:20.730588 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Acquiring lock "5e52bd75-8566-4472-8147-99655013bc83" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:20.730588 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "5e52bd75-8566-4472-8147-99655013bc83" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:20.730588 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Attaching volume a3e10d6f-9ca6-4492-a73c-310434d013ca to /dev/sdc Jun 25 04:42:20.738508 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-4c1f186a-27b2-42f2-9b48-cdfc79c0de16 req-ce1f02e6-e72d-4608-b2c0-d93a454f8622 service nova] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Received event network-vif-plugged-189c1769-d72c-42d1-9e3e-1e978c8bf93f {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:20.739579 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4c1f186a-27b2-42f2-9b48-cdfc79c0de16 req-ce1f02e6-e72d-4608-b2c0-d93a454f8622 service nova] Acquiring lock "19180a23-a7e0-4354-b9f4-9ca57062fc06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:20.739703 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4c1f186a-27b2-42f2-9b48-cdfc79c0de16 req-ce1f02e6-e72d-4608-b2c0-d93a454f8622 service nova] Lock "19180a23-a7e0-4354-b9f4-9ca57062fc06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:20.739953 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4c1f186a-27b2-42f2-9b48-cdfc79c0de16 req-ce1f02e6-e72d-4608-b2c0-d93a454f8622 service nova] Lock "19180a23-a7e0-4354-b9f4-9ca57062fc06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:20.740033 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-4c1f186a-27b2-42f2-9b48-cdfc79c0de16 req-ce1f02e6-e72d-4608-b2c0-d93a454f8622 service nova] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Processing event network-vif-plugged-189c1769-d72c-42d1-9e3e-1e978c8bf93f {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:42:20.740207 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-4c1f186a-27b2-42f2-9b48-cdfc79c0de16 req-ce1f02e6-e72d-4608-b2c0-d93a454f8622 service nova] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Received event network-vif-plugged-189c1769-d72c-42d1-9e3e-1e978c8bf93f {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:20.740426 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4c1f186a-27b2-42f2-9b48-cdfc79c0de16 req-ce1f02e6-e72d-4608-b2c0-d93a454f8622 service nova] Acquiring lock "19180a23-a7e0-4354-b9f4-9ca57062fc06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:20.740614 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4c1f186a-27b2-42f2-9b48-cdfc79c0de16 req-ce1f02e6-e72d-4608-b2c0-d93a454f8622 service nova] Lock "19180a23-a7e0-4354-b9f4-9ca57062fc06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:20.740779 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4c1f186a-27b2-42f2-9b48-cdfc79c0de16 req-ce1f02e6-e72d-4608-b2c0-d93a454f8622 service nova] Lock "19180a23-a7e0-4354-b9f4-9ca57062fc06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:20.741445 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-4c1f186a-27b2-42f2-9b48-cdfc79c0de16 req-ce1f02e6-e72d-4608-b2c0-d93a454f8622 service nova] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] No waiting events found dispatching network-vif-plugged-189c1769-d72c-42d1-9e3e-1e978c8bf93f {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:42:20.743196 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:42:20.743444 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-4c1f186a-27b2-42f2-9b48-cdfc79c0de16 req-ce1f02e6-e72d-4608-b2c0-d93a454f8622 service nova] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Received unexpected event network-vif-plugged-189c1769-d72c-42d1-9e3e-1e978c8bf93f for instance with vm_state building and task_state spawning. Jun 25 04:42:20.743658 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-4c1f186a-27b2-42f2-9b48-cdfc79c0de16 req-ce1f02e6-e72d-4608-b2c0-d93a454f8622 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-changed-aa227a29-8d0b-49f2-a71e-233ba6d38b79 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:20.743808 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-4c1f186a-27b2-42f2-9b48-cdfc79c0de16 req-ce1f02e6-e72d-4608-b2c0-d93a454f8622 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Refreshing instance network info cache due to event network-changed-aa227a29-8d0b-49f2-a71e-233ba6d38b79. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:42:20.743967 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4c1f186a-27b2-42f2-9b48-cdfc79c0de16 req-ce1f02e6-e72d-4608-b2c0-d93a454f8622 service nova] Acquiring lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:20.753353 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Guest created on hypervisor {{(pid=98952) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 25 04:42:20.761133 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Instance spawned successfully. Jun 25 04:42:20.761537 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 25 04:42:20.823634 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.80', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003587', 'execute': None}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:42:20.834804 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-ab83cf93-cba9-413e-bea2-77eedc4ab4b6 req-55a985d3-f08b-4772-acd0-96fd10a8b5e3 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:20.840372 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.scaleio [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98952) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 25 04:42:20.872248 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Running cmd (subprocess): nvme version {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:20.905397 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] 'nvme version' failed. Not Retrying. {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 04:42:20.905397 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.nvmeof [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] nvme not present on system {{(pid=98952) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 25 04:42:20.917920 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98952) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 25 04:42:20.920851 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.lightos [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Current host hostNQN and IP(s) are ['10.4.3.80', 'fe80::f816:3eff:feea:dfe4', '192.168.40.6', 'fe80::f816:3eff:fe4f:7c42', '192.168.50.6', 'fe80::f816:3eff:fe6c:e6a6', '192.168.10.6', 'fe80::f816:3eff:fe17:d749', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::b035:28ff:fe70:6f4a', 'fe80::fc16:3eff:fe8c:f883', 'fe80::483f:f2ff:fe48:75ca', 'fe80::fc16:3eff:fe5d:a0ff', 'fe80::b819:93ff:fef3:f5f3', 'fe80::fc16:3eff:fe78:7ac8', 'fe80::1038:1dff:fe1c:d44b', 'fe80::fc16:3eff:feb0:e88f', 'fe80::5c81:6cff:fe82:5221', 'fe80::fc16:3eff:fe3a:4858', 'fe80::fc16:3eff:fe4f:4083'] Jun 25 04:42:20.921604 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 25 04:42:20.921924 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] LIGHTOS: no hostnqn found. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 25 04:42:20.922947 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.80', 'host': 'np0000003587', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c81886224652', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a1feb13-40e2-4ac6-989e-b08a6fc0f283', 'nvme_native_multipath': False} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:42:20.923906 np0000003587 nova-compute[98952]: DEBUG nova.virt.block_device [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Updating existing volume attachment record: 32ec2a4d-2f88-49a8-ad97-3ef3a37a5646 {{(pid=98952) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 25 04:42:20.934936 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Lazy-loading 'flavor' on Instance uuid 54721bc9-c45c-4cb1-9910-f47334e84cd2 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:21.023900 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:21.026977 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:42:21.140992 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:21.272530 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Found default for hw_cdrom_bus of ide {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:21.272530 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Found default for hw_disk_bus of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:21.272530 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Found default for hw_input_bus of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:21.272530 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Found default for hw_pointer_model of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:21.272530 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Found default for hw_video_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:21.272530 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Found default for hw_vif_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:21.297237 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:21.337933 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ab83cf93-cba9-413e-bea2-77eedc4ab4b6 req-55a985d3-f08b-4772-acd0-96fd10a8b5e3 service nova] Releasing lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:42:21.338567 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4c1f186a-27b2-42f2-9b48-cdfc79c0de16 req-ce1f02e6-e72d-4608-b2c0-d93a454f8622 service nova] Acquired lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:42:21.339224 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-4c1f186a-27b2-42f2-9b48-cdfc79c0de16 req-ce1f02e6-e72d-4608-b2c0-d93a454f8622 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Refreshing network info cache for port aa227a29-8d0b-49f2-a71e-233ba6d38b79 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:42:21.402930 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 25 04:42:21.512496 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Calling os-brick to attach iSCSI Volume {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 25 04:42:21.512496 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca', 'iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a3e10d6f-9ca6-4492-a73c-310434d013ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:42:21.512496 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:21.532624 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] During sync_power_state the instance has a pending task (spawning). Skip. Jun 25 04:42:21.533002 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Paused> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:42:21.533117 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] VM Paused (Lifecycle Event) Jun 25 04:42:21.778174 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Took 9.04 seconds to spawn the instance on the hypervisor. Jun 25 04:42:21.778319 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:21.847095 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-4c1f186a-27b2-42f2-9b48-cdfc79c0de16 req-ce1f02e6-e72d-4608-b2c0-d93a454f8622 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:21.943986 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Lock "54721bc9-c45c-4cb1-9910-f47334e84cd2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.521s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:21.969330 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-4c1f186a-27b2-42f2-9b48-cdfc79c0de16 req-ce1f02e6-e72d-4608-b2c0-d93a454f8622 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:42:22.036448 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:22.042717 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:42:22.042960 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] VM Resumed (Lifecycle Event) Jun 25 04:42:22.164540 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-4c1f186a-27b2-42f2-9b48-cdfc79c0de16 req-ce1f02e6-e72d-4608-b2c0-d93a454f8622 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:22.294984 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Took 16.06 seconds to build instance. Jun 25 04:42:22.398238 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Successfully updated port: 40295919-4c2c-4e1e-be95-73e18d612ce4 {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:42:22.426422 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Found WWN 33000000029752971 for multipath device dm-3 {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 25 04:42:22.427525 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.046s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:22.427525 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] <== connect_volume: return (2046ms) {'type': 'block', 'scsi_wwn': '33000000029752971', 'path': '/dev/dm-3', 'multipath_id': '33000000029752971'} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:42:22.427663 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000029752971', 'path': '/dev/dm-3', 'multipath_id': '33000000029752971'} {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 25 04:42:22.430296 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.917s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:22.430296 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca', 'iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a3e10d6f-9ca6-4492-a73c-310434d013ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 25 04:42:22.446420 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:22.446788 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:22.450525 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:22.450525 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:42:22.450808 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:22.451043 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:42:22.466058 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:42:22.466058 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:22.468847 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:42:22.468847 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:22.471885 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8f55e3ea-88b4-4f0c-9fab-936bf4f548ba req-a3524236-d06a-40fe-b7c5-bdf5c9f11bb3 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-changed-40295919-4c2c-4e1e-be95-73e18d612ce4 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:22.472050 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8f55e3ea-88b4-4f0c-9fab-936bf4f548ba req-a3524236-d06a-40fe-b7c5-bdf5c9f11bb3 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Refreshing instance network info cache due to event network-changed-40295919-4c2c-4e1e-be95-73e18d612ce4. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:42:22.472232 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8f55e3ea-88b4-4f0c-9fab-936bf4f548ba req-a3524236-d06a-40fe-b7c5-bdf5c9f11bb3 service nova] Acquiring lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:22.481662 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca] added Jun 25 04:42:22.481662 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:42:22.481662 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:42:22.481662 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:42:22.481662 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:42:22.481662 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:42:22.481662 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:22.481662 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:42:22.481662 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0311(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:42:22.481662 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:42:22.495443 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca] added Jun 25 04:42:22.495443 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:42:22.495443 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:42:22.495443 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:42:22.495443 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:42:22.495443 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:42:22.495443 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:22.495443 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:42:22.495443 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0433(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:42:22.495443 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:42:22.545619 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:22.547650 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:42:22.667113 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4c1f186a-27b2-42f2-9b48-cdfc79c0de16 req-ce1f02e6-e72d-4608-b2c0-d93a454f8622 service nova] Releasing lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:42:22.667508 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8f55e3ea-88b4-4f0c-9fab-936bf4f548ba req-a3524236-d06a-40fe-b7c5-bdf5c9f11bb3 service nova] Acquired lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:42:22.667713 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-8f55e3ea-88b4-4f0c-9fab-936bf4f548ba req-a3524236-d06a-40fe-b7c5-bdf5c9f11bb3 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Refreshing network info cache for port 40295919-4c2c-4e1e-be95-73e18d612ce4 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:42:22.796811 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f7be6fe0-1e5d-44a1-b896-b96be3e48c31 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "19180a23-a7e0-4354-b9f4-9ca57062fc06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.576s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:22.936333 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:41:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1691757098',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-serverbootfromvolumestablerescuetest-server-1691757098',id=7,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-25T04:42:08Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='a5d52ed3b8de460eb65a8fb4ad1b015d',ramdisk_id='',reservation_id='r-8umk47p3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-6878904',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:09Z,user_data=None,user_id='27ebe4b23b624995a52b9313ff9e318a',uuid=9aa3370c-9525-460d-b6fc-40a6461bd725,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62e285cd-c2d8-4883-a400-d57367b20980", "address": "fa:16:3e:e6:e0:22", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "vif_mac": "fa:16:3e:e6:e0:22"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e285cd-c2", "ovs_interfaceid": "62e285cd-c2d8-4883-a400-d57367b20980", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:42:22.936524 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converting VIF {"id": "62e285cd-c2d8-4883-a400-d57367b20980", "address": "fa:16:3e:e6:e0:22", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "vif_mac": "fa:16:3e:e6:e0:22"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e285cd-c2", "ovs_interfaceid": "62e285cd-c2d8-4883-a400-d57367b20980", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:42:22.937402 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:e0:22,bridge_name='br-int',has_traffic_filtering=True,id=62e285cd-c2d8-4883-a400-d57367b20980,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62e285cd-c2') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:42:22.938338 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'pci_devices' on Instance uuid 9aa3370c-9525-460d-b6fc-40a6461bd725 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:23.170248 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-8f55e3ea-88b4-4f0c-9fab-936bf4f548ba req-a3524236-d06a-40fe-b7c5-bdf5c9f11bb3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:23.279314 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-8f55e3ea-88b4-4f0c-9fab-936bf4f548ba req-a3524236-d06a-40fe-b7c5-bdf5c9f11bb3 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:42:23.441986 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Object Instance<9aa3370c-9525-460d-b6fc-40a6461bd725> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] End _get_guest_xml xml= Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: 9aa3370c-9525-460d-b6fc-40a6461bd725 Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: instance-00000007 Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: 196608 Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: tempest-ServerBootFromVolumeStableRescueTest-server-1691757098 Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: 2026-06-25 04:42:19 Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: 192 Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: 0 Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: 0 Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: True Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: bare Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: 0 Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: ide Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: virtio Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: pc Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: virtio Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: virtio Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: virtio Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: tempest-ServerBootFromVolumeStableRescueTest-6878904 Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: 9aa3370c-9525-460d-b6fc-40a6461bd725 Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: 9aa3370c-9525-460d-b6fc-40a6461bd725 Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: hvm Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: 128 Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: 9ed7fd1c-6933-4549-8acc-d425cd2d10a6 Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: Jun 25 04:42:23.445628 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:42:23.458382 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Instance destroyed successfully. Jun 25 04:42:23.481887 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:42:23.496309 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-8f55e3ea-88b4-4f0c-9fab-936bf4f548ba req-a3524236-d06a-40fe-b7c5-bdf5c9f11bb3 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:23.500524 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.40.100 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:42:23.501051 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.50.100 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:42:23.514280 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:23.524076 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:23.530367 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:23.545266 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:23.545266 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:23.545266 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:23.545266 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:23.545266 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:23.545266 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:23.545266 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:23.545266 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:23.545266 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:23.545266 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:23.557343 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:23.557343 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:23.557343 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:23.557343 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:23.557343 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:23.557503 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:23.557503 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:23.557503 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:23.557503 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:23.557503 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:23.606694 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca, portal: 192.168.40.100,3260] Jun 25 04:42:23.606694 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca, portal: 192.168.40.100,3260] successful. Jun 25 04:42:23.606694 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:23.619161 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca, portal: 192.168.50.100,3260] Jun 25 04:42:23.619161 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca, portal: 192.168.50.100,3260] successful. Jun 25 04:42:23.619161 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:23.628242 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:23.634272 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:23.637117 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Successfully updated port: f002d56c-77f0-4fb0-9501-751106b08f89 {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:42:23.644371 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:23.644371 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:23.644371 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:23.644371 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:23.644371 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:23.644371 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:23.644371 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:23.644741 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:23.644741 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:23.644741 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:23.644741 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:23.644741 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:23.644741 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:23.644741 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:23.644978 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.199s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:23.645133 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Connected to 192.168.40.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:42:23.650408 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] HCTL ('11', '-', '-', 0) found on session 7 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:42:23.650575 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:42:23.657297 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:23.657297 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:23.657297 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:23.657297 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:23.657297 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:23.657297 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:23.657297 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:23.657967 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:23.657967 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:23.657967 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:23.657967 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:23.657967 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:23.657967 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:23.657967 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:23.658193 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.207s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:23.658193 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Connected to 192.168.50.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:42:23.659352 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] HCTL ('12', '-', '-', 0) found on session 8 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:42:23.659496 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:42:23.673715 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Searching for a device in session 7 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:42:23.673899 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a3e10d6f-9ca6-4492-a73c-310434d013ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:42:23.696699 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Acquiring lock "54721bc9-c45c-4cb1-9910-f47334e84cd2" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:23.696699 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Lock "54721bc9-c45c-4cb1-9910-f47334e84cd2" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:23.696699 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Attaching volume 52af34af-1c56-4eb9-b8a7-a233eecc1da1 to /dev/vdb Jun 25 04:42:23.698639 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Searching for a device in session 8 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:42:23.701252 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a3e10d6f-9ca6-4492-a73c-310434d013ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:42:23.752812 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.80', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003587', 'execute': None}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:42:23.767011 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.scaleio [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98952) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 25 04:42:23.791301 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Running cmd (subprocess): nvme version {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:23.827058 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] 'nvme version' failed. Not Retrying. {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 04:42:23.827411 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.nvmeof [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] nvme not present on system {{(pid=98952) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 25 04:42:23.838399 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] LIGHTOS: [Errno 111] Connection refused {{(pid=98952) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 25 04:42:23.840878 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.lightos [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Current host hostNQN and IP(s) are ['10.4.3.80', 'fe80::f816:3eff:feea:dfe4', '192.168.40.6', 'fe80::f816:3eff:fe4f:7c42', '192.168.50.6', 'fe80::f816:3eff:fe6c:e6a6', '192.168.10.6', 'fe80::f816:3eff:fe17:d749', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::b035:28ff:fe70:6f4a', 'fe80::fc16:3eff:fe8c:f883', 'fe80::483f:f2ff:fe48:75ca', 'fe80::fc16:3eff:fe5d:a0ff', 'fe80::b819:93ff:fef3:f5f3', 'fe80::fc16:3eff:fe78:7ac8', 'fe80::1038:1dff:fe1c:d44b', 'fe80::fc16:3eff:feb0:e88f', 'fe80::5c81:6cff:fe82:5221', 'fe80::fc16:3eff:fe3a:4858', 'fe80::fc16:3eff:fe4f:4083'] Jun 25 04:42:23.841133 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 25 04:42:23.841225 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] LIGHTOS: no hostnqn found. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 25 04:42:23.841568 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.80', 'host': 'np0000003587', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c81886224652', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a1feb13-40e2-4ac6-989e-b08a6fc0f283', 'nvme_native_multipath': False} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:42:23.841906 np0000003587 nova-compute[98952]: DEBUG nova.virt.block_device [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Updating existing volume attachment record: d984c2f8-b7b9-4c60-ad8b-0ab5654e48d9 {{(pid=98952) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 25 04:42:24.002507 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8f55e3ea-88b4-4f0c-9fab-936bf4f548ba req-a3524236-d06a-40fe-b7c5-bdf5c9f11bb3 service nova] Releasing lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:42:24.141036 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquiring lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:24.141036 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquired lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:42:24.141036 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:42:24.435594 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Calling os-brick to attach iSCSI Volume {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 25 04:42:24.435594 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1', 'iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '52af34af-1c56-4eb9-b8a7-a233eecc1da1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:42:24.435594 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:24.451216 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 25 04:42:24.462577 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-ccb2b52c-40aa-4cc9-b0f4-ac465db11a25 req-1c9c073e-e2fd-4998-9624-f94cd3466f37 service nova] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Received event network-changed-7341532c-194f-4377-b054-438f19235507 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:24.462577 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-ccb2b52c-40aa-4cc9-b0f4-ac465db11a25 req-1c9c073e-e2fd-4998-9624-f94cd3466f37 service nova] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Refreshing instance network info cache due to event network-changed-7341532c-194f-4377-b054-438f19235507. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:42:24.462778 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ccb2b52c-40aa-4cc9-b0f4-ac465db11a25 req-1c9c073e-e2fd-4998-9624-f94cd3466f37 service nova] Acquiring lock "refresh_cache-6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:24.462904 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ccb2b52c-40aa-4cc9-b0f4-ac465db11a25 req-1c9c073e-e2fd-4998-9624-f94cd3466f37 service nova] Acquired lock "refresh_cache-6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:42:24.464522 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-ccb2b52c-40aa-4cc9-b0f4-ac465db11a25 req-1c9c073e-e2fd-4998-9624-f94cd3466f37 service nova] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Refreshing network info cache for port 7341532c-194f-4377-b054-438f19235507 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:42:24.540791 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d1b2b5c6-5a53-43ac-a7e6-df262326935d req-7396eeee-aef0-454d-a812-22be25a91b99 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-changed-f002d56c-77f0-4fb0-9501-751106b08f89 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:24.541230 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d1b2b5c6-5a53-43ac-a7e6-df262326935d req-7396eeee-aef0-454d-a812-22be25a91b99 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Refreshing instance network info cache due to event network-changed-f002d56c-77f0-4fb0-9501-751106b08f89. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:42:24.541649 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d1b2b5c6-5a53-43ac-a7e6-df262326935d req-7396eeee-aef0-454d-a812-22be25a91b99 service nova] Acquiring lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:24.727442 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:42:24.851047 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:24.907900 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:24.967070 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-ccb2b52c-40aa-4cc9-b0f4-ac465db11a25 req-1c9c073e-e2fd-4998-9624-f94cd3466f37 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:24.986465 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:42:24.986625 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:42:24.986765 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:42:24.986891 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] No VIF found with MAC fa:16:3e:e6:e0:22, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:42:24.987433 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Using config drive Jun 25 04:42:25.302642 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:25.393990 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-ccb2b52c-40aa-4cc9-b0f4-ac465db11a25 req-1c9c073e-e2fd-4998-9624-f94cd3466f37 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:25.470410 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Found WWN 3300000001ddd21de for multipath device dm-4 {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 25 04:42:25.470935 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:25.471067 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] <== connect_volume: return (3958ms) {'type': 'block', 'scsi_wwn': '3300000001ddd21de', 'path': '/dev/dm-4', 'multipath_id': '3300000001ddd21de'} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:42:25.471257 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001ddd21de', 'path': '/dev/dm-4', 'multipath_id': '3300000001ddd21de'} {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 25 04:42:25.472728 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.037s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:25.472728 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1', 'iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '52af34af-1c56-4eb9-b8a7-a233eecc1da1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 25 04:42:25.480820 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lazy-loading 'flavor' on Instance uuid 5e52bd75-8566-4472-8147-99655013bc83 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:25.490190 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:25.492322 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'ec2_ids' on Instance uuid 9aa3370c-9525-460d-b6fc-40a6461bd725 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:25.495499 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:25.498808 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:25.501532 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:42:25.501532 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.010s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:25.501532 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:42:25.513112 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:42:25.513112 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:25.524575 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:42:25.524575 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:25.533408 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1] added Jun 25 04:42:25.533408 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:42:25.533408 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:42:25.533408 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:42:25.533408 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:42:25.533408 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:42:25.533408 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:25.533408 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:42:25.533408 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0314(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:42:25.533408 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:42:25.535841 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1] added Jun 25 04:42:25.535841 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:42:25.535841 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:42:25.535841 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:42:25.535841 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:42:25.535841 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:42:25.535841 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:25.536111 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:42:25.536226 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0365(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:42:25.536377 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:42:25.636583 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-ccb2b52c-40aa-4cc9-b0f4-ac465db11a25 req-1c9c073e-e2fd-4998-9624-f94cd3466f37 service nova] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Updated VIF entry in instance network info cache for port 7341532c-194f-4377-b054-438f19235507. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:42:25.636846 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-ccb2b52c-40aa-4cc9-b0f4-ac465db11a25 req-1c9c073e-e2fd-4998-9624-f94cd3466f37 service nova] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Updating instance_info_cache with network_info: [{"id": "7341532c-194f-4377-b054-438f19235507", "address": "fa:16:3e:3a:48:58", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7341532c-19", "ovs_interfaceid": "7341532c-194f-4377-b054-438f19235507", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:25.738925 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:25.981601 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] attach device xml: Jun 25 04:42:25.981601 np0000003587 nova-compute[98952]: Jun 25 04:42:25.981601 np0000003587 nova-compute[98952]: Jun 25 04:42:25.981601 np0000003587 nova-compute[98952]: Jun 25 04:42:25.981601 np0000003587 nova-compute[98952]: Jun 25 04:42:25.981601 np0000003587 nova-compute[98952]: a3e10d6f-9ca6-4492-a73c-310434d013ca Jun 25 04:42:25.981601 np0000003587 nova-compute[98952]:
Jun 25 04:42:25.981601 np0000003587 nova-compute[98952]: Jun 25 04:42:25.981601 np0000003587 nova-compute[98952]: {{(pid=98952) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 25 04:42:25.999027 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Object Instance<9aa3370c-9525-460d-b6fc-40a6461bd725> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:42:25.999146 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'keypairs' on Instance uuid 9aa3370c-9525-460d-b6fc-40a6461bd725 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:26.022865 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:26.138915 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ccb2b52c-40aa-4cc9-b0f4-ac465db11a25 req-1c9c073e-e2fd-4998-9624-f94cd3466f37 service nova] Releasing lock "refresh_cache-6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:42:26.300181 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:26.334213 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:26.334624 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:26.383101 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:26.501651 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Object Instance<9aa3370c-9525-460d-b6fc-40a6461bd725> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:42:26.505201 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:26.532390 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:42:26.536811 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.50.100 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:42:26.544305 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.40.100 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:42:26.551762 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:26.557894 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-db80df3d-16b1-4880-b4bd-05d26ab101fb req-39af79f4-b9da-464e-b385-83a3ded226df service nova] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Received event network-changed-189c1769-d72c-42d1-9e3e-1e978c8bf93f {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:26.557894 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-db80df3d-16b1-4880-b4bd-05d26ab101fb req-39af79f4-b9da-464e-b385-83a3ded226df service nova] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Refreshing instance network info cache due to event network-changed-189c1769-d72c-42d1-9e3e-1e978c8bf93f. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:42:26.558207 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-db80df3d-16b1-4880-b4bd-05d26ab101fb req-39af79f4-b9da-464e-b385-83a3ded226df service nova] Acquiring lock "refresh_cache-19180a23-a7e0-4354-b9f4-9ca57062fc06" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:26.558207 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-db80df3d-16b1-4880-b4bd-05d26ab101fb req-39af79f4-b9da-464e-b385-83a3ded226df service nova] Acquired lock "refresh_cache-19180a23-a7e0-4354-b9f4-9ca57062fc06" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:42:26.558300 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-db80df3d-16b1-4880-b4bd-05d26ab101fb req-39af79f4-b9da-464e-b385-83a3ded226df service nova] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Refreshing network info cache for port 189c1769-d72c-42d1-9e3e-1e978c8bf93f {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:42:26.567624 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:26.570591 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:26.585830 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:26.585830 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:26.585830 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:26.585830 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:26.585830 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:26.585830 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:26.585830 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:26.586104 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:26.586104 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:26.586104 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:26.586104 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:26.586104 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:26.586104 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:26.586104 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:26.586534 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:26.586534 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:26.586534 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:26.586534 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:26.586534 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:26.586534 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:26.586534 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:26.586755 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:26.586755 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:26.586755 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:26.586755 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:26.586755 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:26.586755 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:26.586755 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:26.638838 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1, portal: 192.168.50.100,3260] Jun 25 04:42:26.638838 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1, portal: 192.168.50.100,3260] successful. Jun 25 04:42:26.638838 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:26.648022 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1, portal: 192.168.40.100,3260] Jun 25 04:42:26.648022 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1, portal: 192.168.40.100,3260] successful. Jun 25 04:42:26.648022 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:26.650159 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:26.661170 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:26.673792 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Creating config drive at /opt/stack/data/nova/instances/9aa3370c-9525-460d-b6fc-40a6461bd725/disk.config.rescue Jun 25 04:42:26.677073 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:26.677073 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:26.677073 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:26.677073 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:26.677073 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:26.677073 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:26.677073 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:26.677073 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:26.677073 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:26.677073 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:26.677073 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:26.677073 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:26.677073 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:26.677073 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:26.677073 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:26.677073 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:26.677073 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:26.677073 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:26.677073 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:26.677073 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Connected to 192.168.50.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:42:26.679249 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] HCTL ('13', '-', '-', 0) found on session 9 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:42:26.679249 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Scanning host 13 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:42:26.681601 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:26.681601 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:26.681601 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:26.681601 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:26.681601 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:26.681601 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:26.681601 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:26.681601 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:26.681601 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:26.682016 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:26.682016 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:26.682016 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:26.682016 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:26.682016 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:26.682016 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:26.682016 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:26.682016 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:26.682016 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:26.682787 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:26.682787 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Connected to 192.168.40.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:42:26.684486 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] HCTL ('14', '-', '-', 0) found on session 10 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:42:26.684784 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Scanning host 14 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:42:26.692778 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9aa3370c-9525-460d-b6fc-40a6461bd725/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdwkq0kc3 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:26.717448 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Searching for a device in session 10 and hctl ['14', '*', '*', 0] yield: sdh {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:42:26.717448 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '52af34af-1c56-4eb9-b8a7-a233eecc1da1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:42:26.717448 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Searching for a device in session 9 and hctl ['13', '*', '*', 0] yield: sdi {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:42:26.717448 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '52af34af-1c56-4eb9-b8a7-a233eecc1da1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:42:26.743406 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9aa3370c-9525-460d-b6fc-40a6461bd725/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdwkq0kc3" returned: 0 in 0.050s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:26.796820 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:26.839294 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lazy-loading 'flavor' on Instance uuid 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:27.070746 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-db80df3d-16b1-4880-b4bd-05d26ab101fb req-39af79f4-b9da-464e-b385-83a3ded226df service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:27.259587 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:27.293066 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:27.320854 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:27.326804 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:27.442134 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:27.499611 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 25 04:42:27.507786 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:27.509400 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:27.551960 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Updating instance_info_cache with network_info: [{"id": "e12da27e-2953-4784-80b6-5f7204f4e399", "address": "fa:16:3e:ab:c3:d8", "network": {"id": "179999b1-f8ab-4073-96b7-da830d110303", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1298382094-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape12da27e-29", "ovs_interfaceid": "e12da27e-2953-4784-80b6-5f7204f4e399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e8846aa-559c-48a1-bf9a-ab431fd380ed", "address": "fa:16:3e:6d:cc:4e", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8846aa-55", "ovs_interfaceid": "7e8846aa-559c-48a1-bf9a-ab431fd380ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d1f24c3-d7a8-450a-92d5-0e807355b791", "address": "fa:16:3e:07:d0:f0", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1f24c3-d7", "ovs_interfaceid": "4d1f24c3-d7a8-450a-92d5-0e807355b791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "789bf2ca-f86e-403a-88a3-0103291a84df", "address": "fa:16:3e:e6:93:6b", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap789bf2ca-f8", "ovs_interfaceid": "789bf2ca-f86e-403a-88a3-0103291a84df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aa227a29-8d0b-49f2-a71e-233ba6d38b79", "address": "fa:16:3e:d3:38:9d", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa227a29-8d", "ovs_interfaceid": "aa227a29-8d0b-49f2-a71e-233ba6d38b79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40295919-4c2c-4e1e-be95-73e18d612ce4", "address": "fa:16:3e:06:1d:a0", "network": {"id": "9feb5d39-ce22-4ffd-b5a0-f44a21399308", "bridge": "br-int", "label": "tempest-device-tagging-net2-639540845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40295919-4c", "ovs_interfaceid": "40295919-4c2c-4e1e-be95-73e18d612ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f002d56c-77f0-4fb0-9501-751106b08f89", "address": "fa:16:3e:fe:a0:95", "network": {"id": "9feb5d39-ce22-4ffd-b5a0-f44a21399308", "bridge": "br-int", "label": "tempest-device-tagging-net2-639540845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf002d56c-77", "ovs_interfaceid": "f002d56c-77f0-4fb0-9501-751106b08f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:27.571214 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-db80df3d-16b1-4880-b4bd-05d26ab101fb req-39af79f4-b9da-464e-b385-83a3ded226df service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:27.691208 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] No BDM found with device name sda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:42:27.695461 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:42:27.696350 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] No BDM found with device name sdc, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:42:27.696350 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] No VIF found with MAC fa:16:3e:5d:a0:ff, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:42:27.838862 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-db80df3d-16b1-4880-b4bd-05d26ab101fb req-39af79f4-b9da-464e-b385-83a3ded226df service nova] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Updated VIF entry in instance network info cache for port 189c1769-d72c-42d1-9e3e-1e978c8bf93f. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:42:27.839153 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-db80df3d-16b1-4880-b4bd-05d26ab101fb req-39af79f4-b9da-464e-b385-83a3ded226df service nova] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Updating instance_info_cache with network_info: [{"id": "189c1769-d72c-42d1-9e3e-1e978c8bf93f", "address": "fa:16:3e:4f:40:83", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap189c1769-d7", "ovs_interfaceid": "189c1769-d72c-42d1-9e3e-1e978c8bf93f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:27.853311 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.519s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:28.059158 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Releasing lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:42:28.059158 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Instance network_info: |[{"id": "e12da27e-2953-4784-80b6-5f7204f4e399", "address": "fa:16:3e:ab:c3:d8", "network": {"id": "179999b1-f8ab-4073-96b7-da830d110303", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1298382094-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape12da27e-29", "ovs_interfaceid": "e12da27e-2953-4784-80b6-5f7204f4e399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e8846aa-559c-48a1-bf9a-ab431fd380ed", "address": "fa:16:3e:6d:cc:4e", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8846aa-55", "ovs_interfaceid": "7e8846aa-559c-48a1-bf9a-ab431fd380ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d1f24c3-d7a8-450a-92d5-0e807355b791", "address": "fa:16:3e:07:d0:f0", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1f24c3-d7", "ovs_interfaceid": "4d1f24c3-d7a8-450a-92d5-0e807355b791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "789bf2ca-f86e-403a-88a3-0103291a84df", "address": "fa:16:3e:e6:93:6b", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap789bf2ca-f8", "ovs_interfaceid": "789bf2ca-f86e-403a-88a3-0103291a84df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aa227a29-8d0b-49f2-a71e-233ba6d38b79", "address": "fa:16:3e:d3:38:9d", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa227a29-8d", "ovs_interfaceid": "aa227a29-8d0b-49f2-a71e-233ba6d38b79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40295919-4c2c-4e1e-be95-73e18d612ce4", "address": "fa:16:3e:06:1d:a0", "network": {"id": "9feb5d39-ce22-4ffd-b5a0-f44a21399308", "bridge": "br-int", "label": "tempest-device-tagging-net2-639540845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40295919-4c", "ovs_interfaceid": "40295919-4c2c-4e1e-be95-73e18d612ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f002d56c-77f0-4fb0-9501-751106b08f89", "address": "fa:16:3e:fe:a0:95", "network": {"id": "9feb5d39-ce22-4ffd-b5a0-f44a21399308", "bridge": "br-int", "label": "tempest-device-tagging-net2-639540845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf002d56c-77", "ovs_interfaceid": "f002d56c-77f0-4fb0-9501-751106b08f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 25 04:42:28.059158 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d1b2b5c6-5a53-43ac-a7e6-df262326935d req-7396eeee-aef0-454d-a812-22be25a91b99 service nova] Acquired lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:42:28.059158 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-d1b2b5c6-5a53-43ac-a7e6-df262326935d req-7396eeee-aef0-454d-a812-22be25a91b99 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Refreshing network info cache for port f002d56c-77f0-4fb0-9501-751106b08f89 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:42:28.060164 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Start _get_guest_xml network_info=[{"id": "e12da27e-2953-4784-80b6-5f7204f4e399", "address": "fa:16:3e:ab:c3:d8", "network": {"id": "179999b1-f8ab-4073-96b7-da830d110303", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1298382094-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape12da27e-29", "ovs_interfaceid": "e12da27e-2953-4784-80b6-5f7204f4e399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e8846aa-559c-48a1-bf9a-ab431fd380ed", "address": "fa:16:3e:6d:cc:4e", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8846aa-55", "ovs_interfaceid": "7e8846aa-559c-48a1-bf9a-ab431fd380ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d1f24c3-d7a8-450a-92d5-0e807355b791", "address": "fa:16:3e:07:d0:f0", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1f24c3-d7", "ovs_interfaceid": "4d1f24c3-d7a8-450a-92d5-0e807355b791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "789bf2ca-f86e-403a-88a3-0103291a84df", "address": "fa:16:3e:e6:93:6b", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap789bf2ca-f8", "ovs_interfaceid": "789bf2ca-f86e-403a-88a3-0103291a84df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aa227a29-8d0b-49f2-a71e-233ba6d38b79", "address": "fa:16:3e:d3:38:9d", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa227a29-8d", "ovs_interfaceid": "aa227a29-8d0b-49f2-a71e-233ba6d38b79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40295919-4c2c-4e1e-be95-73e18d612ce4", "address": "fa:16:3e:06:1d:a0", "network": {"id": "9feb5d39-ce22-4ffd-b5a0-f44a21399308", "bridge": "br-int", "label": "tempest-device-tagging-net2-639540845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40295919-4c", "ovs_interfaceid": "40295919-4c2c-4e1e-be95-73e18d612ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f002d56c-77f0-4fb0-9501-751106b08f89", "address": "fa:16:3e:fe:a0:95", "network": {"id": "9feb5d39-ce22-4ffd-b5a0-f44a21399308", "bridge": "br-int", "label": "tempest-device-tagging-net2-639540845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf002d56c-77", "ovs_interfaceid": "f002d56c-77f0-4fb0-9501-751106b08f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1a3ea2da-7efc-4b95-830c-6c043906aa00', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9c033870-f167-4235-86ff-98005452a16c', 'attached_at': '', 'detached_at': '', 'volume_id': '1a3ea2da-7efc-4b95-830c-6c043906aa00', 'serial': '1a3ea2da-7efc-4b95-830c-6c043906aa00'}, 'attachment_id': '9e69f33b-39f2-43db-9923-5bce949c3d5b', 'device_type': 'disk', 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': 1, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9c033870-f167-4235-86ff-98005452a16c', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', 'serial': 'e0002b7f-67b9-4af1-82f9-7e5e8a55faaf'}, 'attachment_id': 'a8c64e6b-3090-4c15-8306-ed14442b5e7b', 'device_type': 'disk', 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'boot_index': 2, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cc7be47d-8d0a-4286-86d2-621b59df6075', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9c033870-f167-4235-86ff-98005452a16c', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc7be47d-8d0a-4286-86d2-621b59df6075', 'serial': 'cc7be47d-8d0a-4286-86d2-621b59df6075'}, 'attachment_id': '3aceea7e-9cba-4682-8830-2c86098781a3', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:42:28.063753 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:42:28.065745 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1434404356', uuid='9c033870-f167-4235-86ff-98005452a16c'), owner=OwnerMeta(userid='be344ec982ae4676b6a89325d3578d73', username='tempest-TaggedBootDevicesTest_v242-479660225-project-member', projectid='1c1a4dead6ad4de1bb75262d9c52bbee', projectname='tempest-TaggedBootDevicesTest_v242-479660225'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e12da27e-2953-4784-80b6-5f7204f4e399", "address": "fa:16:3e:ab:c3:d8", "network": {"id": "179999b1-f8ab-4073-96b7-da830d110303", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1298382094-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape12da27e-29", "ovs_interfaceid": "e12da27e-2953-4784-80b6-5f7204f4e399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e8846aa-559c-48a1-bf9a-ab431fd380ed", "address": "fa:16:3e:6d:cc:4e", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8846aa-55", "ovs_interfaceid": "7e8846aa-559c-48a1-bf9a-ab431fd380ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d1f24c3-d7a8-450a-92d5-0e807355b791", "address": "fa:16:3e:07:d0:f0", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1f24c3-d7", "ovs_interfaceid": "4d1f24c3-d7a8-450a-92d5-0e807355b791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "789bf2ca-f86e-403a-88a3-0103291a84df", "address": "fa:16:3e:e6:93:6b", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap789bf2ca-f8", "ovs_interfaceid": "789bf2ca-f86e-403a-88a3-0103291a84df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aa227a29-8d0b-49f2-a71e-233ba6d38b79", "address": "fa:16:3e:d3:38:9d", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa227a29-8d", "ovs_interfaceid": "aa227a29-8d0b-49f2-a71e-233ba6d38b79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40295919-4c2c-4e1e-be95-73e18d612ce4", "address": "fa:16:3e:06:1d:a0", "network": {"id": "9feb5d39-ce22-4ffd-b5a0-f44a21399308", "bridge": "br-int", "label": "tempest-device-tagging-net2-639540845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40295919-4c", "ovs_interfaceid": "40295919-4c2c-4e1e-be95-73e18d612ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f002d56c-77f0-4fb0-9501-751106b08f89", "address": "fa:16:3e:fe:a0:95", "network": {"id": "9feb5d39-ce22-4ffd-b5a0-f44a21399308", "bridge": "br-int", "label": "tempest-device-tagging-net2-639540845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf002d56c-77", "ovs_interfaceid": "f002d56c-77f0-4fb0-9501-751106b08f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362548.0641313) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:42:28.066443 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:42:28.066593 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:42:28.070732 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:42:28.070732 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:42:28.072710 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:42:28.072710 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:42:28.072710 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:42:28.072710 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:42:28.072710 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:42:28.072710 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:42:28.072980 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:42:28.072980 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:42:28.073171 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:42:28.073171 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:42:28.073342 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:42:28.073772 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:42:28.089346 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Calling os-brick to attach iSCSI Volume {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 25 04:42:28.089836 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1a3ea2da-7efc-4b95-830c-6c043906aa00', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:42:28.090016 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:28.346814 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-db80df3d-16b1-4880-b4bd-05d26ab101fb req-39af79f4-b9da-464e-b385-83a3ded226df service nova] Releasing lock "refresh_cache-19180a23-a7e0-4354-b9f4-9ca57062fc06" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:42:28.424413 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Removed pending STOPPED event for 9aa3370c-9525-460d-b6fc-40a6461bd725 due to new event Resumed> {{(pid=98952) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 25 04:42:28.425014 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:42:28.426808 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] VM Resumed (Lifecycle Event) Jun 25 04:42:28.430779 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-cb7837e7-c0ac-4d9f-8d26-b767f0367fed tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:28.519881 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Found WWN 33000000080a5b275 for multipath device dm-5 {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 25 04:42:28.520757 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.049s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:28.521390 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] <== connect_volume: return (4086ms) {'type': 'block', 'scsi_wwn': '33000000080a5b275', 'path': '/dev/dm-5', 'multipath_id': '33000000080a5b275'} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:42:28.521390 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000080a5b275', 'path': '/dev/dm-5', 'multipath_id': '33000000080a5b275'} {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 25 04:42:28.522153 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.432s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:28.522597 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1a3ea2da-7efc-4b95-830c-6c043906aa00', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 25 04:42:28.526486 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Lazy-loading 'flavor' on Instance uuid 54721bc9-c45c-4cb1-9910-f47334e84cd2 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:28.536381 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:28.537154 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:28.537991 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:28.538766 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:28.539221 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:42:28.539726 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:42:28.554824 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:42:28.554824 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:28.561168 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-d1b2b5c6-5a53-43ac-a7e6-df262326935d req-7396eeee-aef0-454d-a812-22be25a91b99 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:28.565394 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:42:28.565394 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:28.573827 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00] added Jun 25 04:42:28.573827 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:42:28.573827 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:42:28.573827 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:42:28.573827 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:42:28.573827 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:42:28.573827 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:28.573827 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:42:28.573827 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.035(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:42:28.573827 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:42:28.581988 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00] added Jun 25 04:42:28.581988 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:42:28.581988 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:42:28.581988 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:42:28.581988 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:42:28.581988 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:42:28.581988 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:28.582286 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:42:28.582980 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0434(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:42:28.582980 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:42:28.654396 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2462cc72-37fc-4548-b3ba-206d7256beea req-260446ad-797c-4f3a-8072-139a25b4f74b service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Received event network-vif-plugged-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:28.654731 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2462cc72-37fc-4548-b3ba-206d7256beea req-260446ad-797c-4f3a-8072-139a25b4f74b service nova] Acquiring lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:28.658441 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2462cc72-37fc-4548-b3ba-206d7256beea req-260446ad-797c-4f3a-8072-139a25b4f74b service nova] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:28.658441 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2462cc72-37fc-4548-b3ba-206d7256beea req-260446ad-797c-4f3a-8072-139a25b4f74b service nova] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:28.658441 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2462cc72-37fc-4548-b3ba-206d7256beea req-260446ad-797c-4f3a-8072-139a25b4f74b service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] No waiting events found dispatching network-vif-plugged-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:42:28.658441 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-2462cc72-37fc-4548-b3ba-206d7256beea req-260446ad-797c-4f3a-8072-139a25b4f74b service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Received unexpected event network-vif-plugged-62e285cd-c2d8-4883-a400-d57367b20980 for instance with vm_state rescued and task_state None. Jun 25 04:42:28.658441 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2462cc72-37fc-4548-b3ba-206d7256beea req-260446ad-797c-4f3a-8072-139a25b4f74b service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Received event network-vif-plugged-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:28.658441 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2462cc72-37fc-4548-b3ba-206d7256beea req-260446ad-797c-4f3a-8072-139a25b4f74b service nova] Acquiring lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:28.658441 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2462cc72-37fc-4548-b3ba-206d7256beea req-260446ad-797c-4f3a-8072-139a25b4f74b service nova] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:28.658441 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2462cc72-37fc-4548-b3ba-206d7256beea req-260446ad-797c-4f3a-8072-139a25b4f74b service nova] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:28.658441 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2462cc72-37fc-4548-b3ba-206d7256beea req-260446ad-797c-4f3a-8072-139a25b4f74b service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] No waiting events found dispatching network-vif-plugged-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:42:28.658441 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-2462cc72-37fc-4548-b3ba-206d7256beea req-260446ad-797c-4f3a-8072-139a25b4f74b service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Received unexpected event network-vif-plugged-62e285cd-c2d8-4883-a400-d57367b20980 for instance with vm_state rescued and task_state None. Jun 25 04:42:28.937734 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:28.950592 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:42:29.031789 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Attempting to attach volume 52af34af-1c56-4eb9-b8a7-a233eecc1da1 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98952) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 25 04:42:29.036881 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] attach device xml: Jun 25 04:42:29.036881 np0000003587 nova-compute[98952]: Jun 25 04:42:29.036881 np0000003587 nova-compute[98952]: Jun 25 04:42:29.036881 np0000003587 nova-compute[98952]: Jun 25 04:42:29.036881 np0000003587 nova-compute[98952]: Jun 25 04:42:29.036881 np0000003587 nova-compute[98952]: 52af34af-1c56-4eb9-b8a7-a233eecc1da1 Jun 25 04:42:29.036881 np0000003587 nova-compute[98952]: Jun 25 04:42:29.036881 np0000003587 nova-compute[98952]: {{(pid=98952) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 25 04:42:29.098723 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-d1b2b5c6-5a53-43ac-a7e6-df262326935d req-7396eeee-aef0-454d-a812-22be25a91b99 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:29.300869 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-efe837ff-c5d0-4b14-b5ab-fdd42c14da48 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "5e52bd75-8566-4472-8147-99655013bc83" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 8.572s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:29.426548 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-d1b2b5c6-5a53-43ac-a7e6-df262326935d req-7396eeee-aef0-454d-a812-22be25a91b99 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Updated VIF entry in instance network info cache for port f002d56c-77f0-4fb0-9501-751106b08f89. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:42:29.426548 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-d1b2b5c6-5a53-43ac-a7e6-df262326935d req-7396eeee-aef0-454d-a812-22be25a91b99 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Updating instance_info_cache with network_info: [{"id": "e12da27e-2953-4784-80b6-5f7204f4e399", "address": "fa:16:3e:ab:c3:d8", "network": {"id": "179999b1-f8ab-4073-96b7-da830d110303", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1298382094-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape12da27e-29", "ovs_interfaceid": "e12da27e-2953-4784-80b6-5f7204f4e399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e8846aa-559c-48a1-bf9a-ab431fd380ed", "address": "fa:16:3e:6d:cc:4e", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8846aa-55", "ovs_interfaceid": "7e8846aa-559c-48a1-bf9a-ab431fd380ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d1f24c3-d7a8-450a-92d5-0e807355b791", "address": "fa:16:3e:07:d0:f0", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1f24c3-d7", "ovs_interfaceid": "4d1f24c3-d7a8-450a-92d5-0e807355b791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "789bf2ca-f86e-403a-88a3-0103291a84df", "address": "fa:16:3e:e6:93:6b", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap789bf2ca-f8", "ovs_interfaceid": "789bf2ca-f86e-403a-88a3-0103291a84df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aa227a29-8d0b-49f2-a71e-233ba6d38b79", "address": "fa:16:3e:d3:38:9d", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa227a29-8d", "ovs_interfaceid": "aa227a29-8d0b-49f2-a71e-233ba6d38b79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40295919-4c2c-4e1e-be95-73e18d612ce4", "address": "fa:16:3e:06:1d:a0", "network": {"id": "9feb5d39-ce22-4ffd-b5a0-f44a21399308", "bridge": "br-int", "label": "tempest-device-tagging-net2-639540845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40295919-4c", "ovs_interfaceid": "40295919-4c2c-4e1e-be95-73e18d612ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f002d56c-77f0-4fb0-9501-751106b08f89", "address": "fa:16:3e:fe:a0:95", "network": {"id": "9feb5d39-ce22-4ffd-b5a0-f44a21399308", "bridge": "br-int", "label": "tempest-device-tagging-net2-639540845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf002d56c-77", "ovs_interfaceid": "f002d56c-77f0-4fb0-9501-751106b08f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:29.458338 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:42:29.458938 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] VM Started (Lifecycle Event) Jun 25 04:42:29.577668 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:42:29.583184 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:42:29.594481 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-3deadbdb-621e-4065-8cbf-2a2c327c3284 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Unrescuing Jun 25 04:42:29.594481 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-3deadbdb-621e-4065-8cbf-2a2c327c3284 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "refresh_cache-9aa3370c-9525-460d-b6fc-40a6461bd725" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:29.594481 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-3deadbdb-621e-4065-8cbf-2a2c327c3284 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquired lock "refresh_cache-9aa3370c-9525-460d-b6fc-40a6461bd725" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:42:29.594847 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-3deadbdb-621e-4065-8cbf-2a2c327c3284 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.40.100 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:42:29.598535 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.50.100 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:42:29.608734 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:29.617285 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:29.630025 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:29.641057 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:29.641057 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:29.641057 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:29.641057 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:29.641057 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:29.641057 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:29.641057 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:29.641057 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:29.641057 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:29.641057 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:29.641057 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:29.641057 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:29.641057 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:29.641057 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:29.641057 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:29.641057 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:29.641057 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:29.641057 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:29.655309 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:29.655309 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:29.655309 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:29.655309 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:29.655309 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:29.655309 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:29.655309 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:29.655309 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:29.655309 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:29.655309 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:29.655309 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:29.655309 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:29.655309 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:29.655309 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:29.655309 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:29.655309 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:29.655309 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:29.655309 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:29.684256 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:29.684778 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:29.684980 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Attaching volume 9ed8d9ce-b06c-4856-91a6-090a64fd59c4 to /dev/vdb Jun 25 04:42:29.696072 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00, portal: 192.168.40.100,3260] Jun 25 04:42:29.696072 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00, portal: 192.168.40.100,3260] successful. Jun 25 04:42:29.696072 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:29.704635 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00, portal: 192.168.50.100,3260] Jun 25 04:42:29.704635 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00, portal: 192.168.50.100,3260] successful. Jun 25 04:42:29.704635 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:29.713586 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:29.724049 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:29.738651 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:29.738651 np0000003587 nova-compute[98952]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:29.738651 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:29.738651 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:29.738651 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:29.738651 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:29.738651 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:29.738651 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:29.738651 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:29.738651 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:29.738651 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:29.738651 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:29.738651 np0000003587 nova-compute[98952]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:29.738651 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:29.738651 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:29.738651 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:29.738651 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:29.738651 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:29.738651 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:29.738651 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:29.738651 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:29.738651 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:29.738651 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.200s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:29.738651 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Connected to 192.168.40.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:42:29.747007 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:29.747007 np0000003587 nova-compute[98952]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:29.747007 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:29.747007 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:29.747007 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:29.747007 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:29.747007 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:29.747007 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:29.747007 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:29.747007 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:29.747007 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:29.747399 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:29.747399 np0000003587 nova-compute[98952]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:29.747399 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:29.747399 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:29.747399 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:29.747399 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:29.747399 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:29.747399 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:29.747399 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:29.747399 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:29.747399 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:29.748105 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] HCTL ('15', '-', '-', 0) found on session 11 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:42:29.748305 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:42:29.750264 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.211s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:29.750264 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Connected to 192.168.50.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:42:29.751761 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] HCTL ('16', '-', '-', 0) found on session 12 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:42:29.751863 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:42:29.813837 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.80', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003587', 'execute': None}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:42:29.813837 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Searching for a device in session 11 and hctl ['15', '*', '*', 0] yield: sdk {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:42:29.813837 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1a3ea2da-7efc-4b95-830c-6c043906aa00', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:42:29.813837 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Searching for a device in session 12 and hctl ['16', '*', '*', 0] yield: sdj {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:42:29.813837 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1a3ea2da-7efc-4b95-830c-6c043906aa00', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:42:29.813837 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.scaleio [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98952) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 25 04:42:29.841076 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): nvme version {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:29.858980 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Acquiring lock "5e52bd75-8566-4472-8147-99655013bc83" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:29.865943 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:29.871376 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "5e52bd75-8566-4472-8147-99655013bc83" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.003s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:29.877093 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] 'nvme version' failed. Not Retrying. {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 04:42:29.877093 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] nvme not present on system {{(pid=98952) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 25 04:42:29.898018 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98952) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 25 04:42:29.899424 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.lightos [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Current host hostNQN and IP(s) are ['10.4.3.80', 'fe80::f816:3eff:feea:dfe4', '192.168.40.6', 'fe80::f816:3eff:fe4f:7c42', '192.168.50.6', 'fe80::f816:3eff:fe6c:e6a6', '192.168.10.6', 'fe80::f816:3eff:fe17:d749', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::b035:28ff:fe70:6f4a', 'fe80::fc16:3eff:fe8c:f883', 'fe80::483f:f2ff:fe48:75ca', 'fe80::fc16:3eff:fe5d:a0ff', 'fe80::b819:93ff:fef3:f5f3', 'fe80::fc16:3eff:fe78:7ac8', 'fe80::1038:1dff:fe1c:d44b', 'fe80::fc16:3eff:feb0:e88f', 'fe80::5c81:6cff:fe82:5221', 'fe80::fc16:3eff:fe3a:4858', 'fe80::fc16:3eff:fe4f:4083', 'fe80::fc16:3eff:fee6:e022'] Jun 25 04:42:29.899424 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 25 04:42:29.900321 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] LIGHTOS: no hostnqn found. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 25 04:42:29.900321 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.80', 'host': 'np0000003587', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c81886224652', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a1feb13-40e2-4ac6-989e-b08a6fc0f283', 'nvme_native_multipath': False} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:42:29.900321 np0000003587 nova-compute[98952]: DEBUG nova.virt.block_device [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Updating existing volume attachment record: 68df2f76-8e21-4c34-b049-7345c5418513 {{(pid=98952) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 25 04:42:29.932118 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d1b2b5c6-5a53-43ac-a7e6-df262326935d req-7396eeee-aef0-454d-a812-22be25a91b99 service nova] Releasing lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:42:29.963501 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:29.968830 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:42:29.982828 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:30.100525 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-3deadbdb-621e-4065-8cbf-2a2c327c3284 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:30.380877 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Detaching volume a3e10d6f-9ca6-4492-a73c-310434d013ca Jun 25 04:42:30.465486 np0000003587 nova-compute[98952]: INFO nova.virt.block_device [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Attempting to driver detach volume a3e10d6f-9ca6-4492-a73c-310434d013ca from mountpoint /dev/sdc Jun 25 04:42:30.475212 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] During sync_power_state the instance has a pending task (unrescuing). Skip. Jun 25 04:42:30.476816 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Found disk sdc by alias ua-a3e10d6f-9ca6-4492-a73c-310434d013ca {{(pid=98952) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 25 04:42:30.479690 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Found disk sdc by alias ua-a3e10d6f-9ca6-4492-a73c-310434d013ca {{(pid=98952) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 25 04:42:30.479862 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Attempting to detach device sdc from instance 5e52bd75-8566-4472-8147-99655013bc83 from the persistent domain config. {{(pid=98952) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 25 04:42:30.480253 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] detach device xml: Jun 25 04:42:30.480253 np0000003587 nova-compute[98952]: Jun 25 04:42:30.480253 np0000003587 nova-compute[98952]: Jun 25 04:42:30.480253 np0000003587 nova-compute[98952]: Jun 25 04:42:30.480253 np0000003587 nova-compute[98952]: Jun 25 04:42:30.480253 np0000003587 nova-compute[98952]: a3e10d6f-9ca6-4492-a73c-310434d013ca Jun 25 04:42:30.480253 np0000003587 nova-compute[98952]:
Jun 25 04:42:30.480253 np0000003587 nova-compute[98952]: Jun 25 04:42:30.480253 np0000003587 nova-compute[98952]: {{(pid=98952) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 25 04:42:30.494071 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Successfully detached device sdc from instance 5e52bd75-8566-4472-8147-99655013bc83 from the persistent domain config. Jun 25 04:42:30.494517 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] (1/8): Attempting to detach device sdc with device alias ua-a3e10d6f-9ca6-4492-a73c-310434d013ca from instance 5e52bd75-8566-4472-8147-99655013bc83 from the live domain config. {{(pid=98952) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 25 04:42:30.494801 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] detach device xml: Jun 25 04:42:30.494801 np0000003587 nova-compute[98952]: Jun 25 04:42:30.494801 np0000003587 nova-compute[98952]: Jun 25 04:42:30.494801 np0000003587 nova-compute[98952]: Jun 25 04:42:30.494801 np0000003587 nova-compute[98952]: Jun 25 04:42:30.494801 np0000003587 nova-compute[98952]: a3e10d6f-9ca6-4492-a73c-310434d013ca Jun 25 04:42:30.494801 np0000003587 nova-compute[98952]:
Jun 25 04:42:30.494801 np0000003587 nova-compute[98952]: Jun 25 04:42:30.494801 np0000003587 nova-compute[98952]: {{(pid=98952) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 25 04:42:30.529584 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Calling os-brick to attach iSCSI Volume {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 25 04:42:30.529584 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:42:30.529584 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:30.540306 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 25 04:42:30.588123 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-3deadbdb-621e-4065-8cbf-2a2c327c3284 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:30.688745 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Received event ua-a3e10d6f-9ca6-4492-a73c-310434d013ca> from libvirt while the driver is waiting for it; dispatched. {{(pid=98952) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 25 04:42:30.689464 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Start waiting for the detach event from libvirt for device sdc with device alias ua-a3e10d6f-9ca6-4492-a73c-310434d013ca for instance 5e52bd75-8566-4472-8147-99655013bc83 {{(pid=98952) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 25 04:42:30.697673 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Successfully detached device sdc from instance 5e52bd75-8566-4472-8147-99655013bc83 from the live domain config. Jun 25 04:42:30.702331 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] calling os-brick to detach iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 25 04:42:30.703469 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca', 'iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a3e10d6f-9ca6-4492-a73c-310434d013ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:42:30.703469 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:30.755457 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:42:30.755628 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:42:30.755773 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:42:30.755989 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] No VIF found with MAC fa:16:3e:b0:e8:8f, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:42:30.816125 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-3deadbdb-621e-4065-8cbf-2a2c327c3284 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Updating instance_info_cache with network_info: [{"id": "62e285cd-c2d8-4883-a400-d57367b20980", "address": "fa:16:3e:e6:e0:22", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e285cd-c2", "ovs_interfaceid": "62e285cd-c2d8-4883-a400-d57367b20980", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:30.873828 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004629800000657269 future=) was cancelled during its delay period, skipping {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:42:30.873930 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:42:31.301249 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:31.321173 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-3deadbdb-621e-4065-8cbf-2a2c327c3284 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Releasing lock "refresh_cache-9aa3370c-9525-460d-b6fc-40a6461bd725" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:42:31.321821 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-3deadbdb-621e-4065-8cbf-2a2c327c3284 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'flavor' on Instance uuid 9aa3370c-9525-460d-b6fc-40a6461bd725 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:31.563206 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Found WWN 330000000561a10be for multipath device dm-6 {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 25 04:42:31.563737 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:31.564380 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] <== connect_volume: return (3474ms) {'type': 'block', 'scsi_wwn': '330000000561a10be', 'path': '/dev/dm-6', 'multipath_id': '330000000561a10be'} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:42:31.564380 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000561a10be', 'path': '/dev/dm-6', 'multipath_id': '330000000561a10be'} {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 25 04:42:31.565187 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.036s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:31.565480 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 25 04:42:31.579589 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:31.580265 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:31.580449 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:42:31.581083 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:31.581694 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:31.581798 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:42:31.599767 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:42:31.599767 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:31.599767 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:42:31.599767 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:31.615438 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4] added Jun 25 04:42:31.615438 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:42:31.615438 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:42:31.615438 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:42:31.615438 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:42:31.615438 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:42:31.615438 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:31.615438 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:42:31.615438 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.035(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:42:31.615438 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:42:31.627333 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4] added Jun 25 04:42:31.627333 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:42:31.627333 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:42:31.627333 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:42:31.627333 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:42:31.627333 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:42:31.627333 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:31.628101 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:42:31.628101 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.046(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:42:31.628101 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:42:31.870686 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:31.875160 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:31.893345 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:32.061297 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:32.069769 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:32.074712 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Calling os-brick to attach iSCSI Volume {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 25 04:42:32.075104 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:42:32.075290 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:32.180269 np0000003587 nova-compute[98952]: DEBUG nova.utils [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Queued Task(fn=>, remaining_delay=14.999391110000033 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:42:32.180856 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.998779946000013 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:42:32.183122 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.996558246000177 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:42:32.188122 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Instance destroyed successfully. Jun 25 04:42:32.188869 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-3deadbdb-621e-4065-8cbf-2a2c327c3284 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'numa_topology' on Instance uuid 9aa3370c-9525-460d-b6fc-40a6461bd725 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:32.330791 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-977eea26-22a7-4f0f-9c77-aa0cf38e3ede tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Lock "54721bc9-c45c-4cb1-9910-f47334e84cd2" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 8.651s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:32.376879 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:32.401390 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cdfc09b0-a950-4a06-97df-4bac4de46b17 tempest-VolumesAssistedSnapshotsTest-922991479 tempest-VolumesAssistedSnapshotsTest-922991479-project] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] volume_snapshot_create: create_info: {'snapshot_id': 'aa3db4ea-1a2b-4499-a934-8018ff34717a', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=98952) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3759}} Jun 25 04:42:32.404477 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cdfc09b0-a950-4a06-97df-4bac4de46b17 tempest-VolumesAssistedSnapshotsTest-922991479 tempest-VolumesAssistedSnapshotsTest-922991479-project] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] snap xml: Jun 25 04:42:32.404477 np0000003587 nova-compute[98952]: Jun 25 04:42:32.404477 np0000003587 nova-compute[98952]: Jun 25 04:42:32.404477 np0000003587 nova-compute[98952]: Jun 25 04:42:32.404477 np0000003587 nova-compute[98952]: Jun 25 04:42:32.404477 np0000003587 nova-compute[98952]: Jun 25 04:42:32.404477 np0000003587 nova-compute[98952]: Jun 25 04:42:32.404477 np0000003587 nova-compute[98952]: Jun 25 04:42:32.404477 np0000003587 nova-compute[98952]: Jun 25 04:42:32.404477 np0000003587 nova-compute[98952]: {{(pid=98952) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3700}} Jun 25 04:42:32.404978 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-cdfc09b0-a950-4a06-97df-4bac4de46b17 tempest-VolumesAssistedSnapshotsTest-922991479 tempest-VolumesAssistedSnapshotsTest-922991479-project] Lazy-loading 'system_metadata' on Instance uuid 54721bc9-c45c-4cb1-9910-f47334e84cd2 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:32.471802 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-dc0e49b7-3582-4870-8549-fdaff84ab334 tempest-VolumesAssistedSnapshotsTest-922991479 tempest-VolumesAssistedSnapshotsTest-922991479-project] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] volume_snapshot_delete: delete_info: {'volume_id': '52af34af-1c56-4eb9-b8a7-a233eecc1da1'} {{(pid=98952) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3867}} Jun 25 04:42:32.489392 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [None req-dc0e49b7-3582-4870-8549-fdaff84ab334 tempest-VolumesAssistedSnapshotsTest-922991479 tempest-VolumesAssistedSnapshotsTest-922991479-project] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type' Jun 25 04:42:32.489392 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Traceback (most recent call last): Jun 25 04:42:32.489392 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4040, in volume_snapshot_delete Jun 25 04:42:32.489392 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] self._volume_snapshot_delete(context, instance, volume_id, Jun 25 04:42:32.489392 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3870, in _volume_snapshot_delete Jun 25 04:42:32.489392 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] if delete_info['type'] != 'qcow2': Jun 25 04:42:32.489392 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] ~~~~~~~~~~~^^^^^^^^ Jun 25 04:42:32.489392 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] KeyError: 'type' Jun 25 04:42:32.489392 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [None req-dc0e49b7-3582-4870-8549-fdaff84ab334 tempest-VolumesAssistedSnapshotsTest-922991479 tempest-VolumesAssistedSnapshotsTest-922991479-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found. Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4040, in volume_snapshot_delete Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver self._volume_snapshot_delete(context, instance, volume_id, Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3870, in _volume_snapshot_delete Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver if delete_info['type'] != 'qcow2': Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver ~~~~~~~~~~~^^^^^^^^ Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver KeyError: 'type' Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-c21dd6c8-bb64-49c1-99ca-01683cedfd95) Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3599, in _volume_snapshot_update_status Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver self._volume_api.update_snapshot_status(context, Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver res = method(self, ctx, *args, **kwargs) Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found. Jun 25 04:42:32.556676 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server [None req-dc0e49b7-3582-4870-8549-fdaff84ab334 tempest-VolumesAssistedSnapshotsTest-922991479 tempest-VolumesAssistedSnapshotsTest-922991479-project] Exception during message handling: KeyError: 'type' Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server self.force_reraise() Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server raise self.value Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw) Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 4829, in volume_snapshot_delete Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server self.driver.volume_snapshot_delete(context, instance, volume_id, Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4043, in volume_snapshot_delete Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server self.force_reraise() Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server raise self.value Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4040, in volume_snapshot_delete Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server self._volume_snapshot_delete(context, instance, volume_id, Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3870, in _volume_snapshot_delete Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server if delete_info['type'] != 'qcow2': Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server ~~~~~~~~~~~^^^^^^^^ Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server KeyError: 'type' Jun 25 04:42:32.567860 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server Jun 25 04:42:32.582193 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d7d57c6f-0cc2-4f2c-9d07-5a08d6c3cf3a req-7b6b77b6-f804-451c-93d7-72a956fcbded service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Received event network-vif-unplugged-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:32.582284 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d7d57c6f-0cc2-4f2c-9d07-5a08d6c3cf3a req-7b6b77b6-f804-451c-93d7-72a956fcbded service nova] Acquiring lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:32.582418 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d7d57c6f-0cc2-4f2c-9d07-5a08d6c3cf3a req-7b6b77b6-f804-451c-93d7-72a956fcbded service nova] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:32.582534 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d7d57c6f-0cc2-4f2c-9d07-5a08d6c3cf3a req-7b6b77b6-f804-451c-93d7-72a956fcbded service nova] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:32.582737 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d7d57c6f-0cc2-4f2c-9d07-5a08d6c3cf3a req-7b6b77b6-f804-451c-93d7-72a956fcbded service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] No waiting events found dispatching network-vif-unplugged-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:42:32.582834 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-d7d57c6f-0cc2-4f2c-9d07-5a08d6c3cf3a req-7b6b77b6-f804-451c-93d7-72a956fcbded service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Received unexpected event network-vif-unplugged-62e285cd-c2d8-4883-a400-d57367b20980 for instance with vm_state rescued and task_state unrescuing. Jun 25 04:42:32.616252 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:42:32.628959 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.40.100 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:42:32.639217 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.50.100 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:42:32.647755 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:32.656665 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:32.667436 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:32.688170 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:32.688170 np0000003587 nova-compute[98952]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:32.688170 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:32.688170 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:32.688170 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:32.688170 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:32.688170 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:32.688170 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:32.688170 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:32.688170 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:32.688170 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:32.690842 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-3deadbdb-621e-4065-8cbf-2a2c327c3284 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Object Instance<9aa3370c-9525-460d-b6fc-40a6461bd725> lazy-loaded attributes: flavor,numa_topology {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:42:32.744223 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4, portal: 192.168.50.100,3260] Jun 25 04:42:32.744223 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4, portal: 192.168.50.100,3260] successful. Jun 25 04:42:32.744223 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:32.755497 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4, portal: 192.168.40.100,3260] Jun 25 04:42:32.755497 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4, portal: 192.168.40.100,3260] successful. Jun 25 04:42:32.755497 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:32.763661 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:32.773890 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:32.788731 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:32.788731 np0000003587 nova-compute[98952]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:32.788731 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:32.788731 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:32.788731 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:32.788731 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:32.788731 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:32.788731 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:32.788731 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:32.788731 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:32.788731 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:32.788731 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:32.788731 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:32.790989 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:32.790989 np0000003587 nova-compute[98952]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:32.790989 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:32.790989 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:32.790989 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:32.790989 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:32.790989 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:32.790989 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:32.790989 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:32.790989 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:32.790989 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:32.790989 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:32.790989 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:32.790989 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.208s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:32.790989 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to 192.168.50.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:42:32.791523 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] HCTL ('17', '-', '-', 0) found on session 13 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:42:32.791750 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:32.802797 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.223s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:32.803974 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to 192.168.40.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:42:32.804909 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] HCTL ('18', '-', '-', 0) found on session 14 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:42:32.804909 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:42:32.816184 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching for a device in session 13 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:42:32.816351 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:42:32.826992 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching for a device in session 14 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:42:32.826992 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:42:32.908427 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-cdfc09b0-a950-4a06-97df-4bac4de46b17 tempest-VolumesAssistedSnapshotsTest-922991479 tempest-VolumesAssistedSnapshotsTest-922991479-project] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Skipping quiescing instance: QEMU guest agent is not enabled. Jun 25 04:42:32.918768 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [None req-cdfc09b0-a950-4a06-97df-4bac4de46b17 tempest-VolumesAssistedSnapshotsTest-922991479 tempest-VolumesAssistedSnapshotsTest-922991479-project] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 25 04:42:32.918768 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Traceback (most recent call last): Jun 25 04:42:32.918768 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3727, in _volume_snapshot_create Jun 25 04:42:32.918768 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jun 25 04:42:32.918768 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jun 25 04:42:32.918768 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] self._domain.snapshotCreateXML(device_xml, flags=flags) Jun 25 04:42:32.918768 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jun 25 04:42:32.918768 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] raise libvirtError('virDomainSnapshotCreateXML() failed') Jun 25 04:42:32.918768 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 25 04:42:32.918768 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Jun 25 04:42:32.920761 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [None req-cdfc09b0-a950-4a06-97df-4bac4de46b17 tempest-VolumesAssistedSnapshotsTest-922991479 tempest-VolumesAssistedSnapshotsTest-922991479-project] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 25 04:42:32.920761 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Traceback (most recent call last): Jun 25 04:42:32.920761 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3777, in volume_snapshot_create Jun 25 04:42:32.920761 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] self._volume_snapshot_create(context, instance, guest, Jun 25 04:42:32.920761 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3727, in _volume_snapshot_create Jun 25 04:42:32.920761 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jun 25 04:42:32.920761 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jun 25 04:42:32.920761 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] self._domain.snapshotCreateXML(device_xml, flags=flags) Jun 25 04:42:32.920761 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jun 25 04:42:32.920761 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] raise libvirtError('virDomainSnapshotCreateXML() failed') Jun 25 04:42:32.920761 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 25 04:42:32.920761 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver [None req-cdfc09b0-a950-4a06-97df-4bac4de46b17 tempest-VolumesAssistedSnapshotsTest-922991479 tempest-VolumesAssistedSnapshotsTest-922991479-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot aa3db4ea-1a2b-4499-a934-8018ff34717a could not be found. Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3777, in volume_snapshot_create Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver self._volume_snapshot_create(context, instance, guest, Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3727, in _volume_snapshot_create Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver self._domain.snapshotCreateXML(device_xml, flags=flags) Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver raise libvirtError('virDomainSnapshotCreateXML() failed') Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot aa3db4ea-1a2b-4499-a934-8018ff34717a could not be found. (HTTP 404) (Request-ID: req-10e660a2-9529-4c76-bf45-8c568310fc83) Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3599, in _volume_snapshot_update_status Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver self._volume_api.update_snapshot_status(context, Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver res = method(self, ctx, *args, **kwargs) Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot aa3db4ea-1a2b-4499-a934-8018ff34717a could not be found. Jun 25 04:42:32.967210 np0000003587 nova-compute[98952]: ERROR nova.virt.libvirt.driver Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server [None req-cdfc09b0-a950-4a06-97df-4bac4de46b17 tempest-VolumesAssistedSnapshotsTest-922991479 tempest-VolumesAssistedSnapshotsTest-922991479-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server self.force_reraise() Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server raise self.value Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw) Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 4817, in volume_snapshot_create Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server self.driver.volume_snapshot_create(context, instance, volume_id, Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3780, in volume_snapshot_create Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server self.force_reraise() Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server raise self.value Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3777, in volume_snapshot_create Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server self._volume_snapshot_create(context, instance, guest, Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3727, in _volume_snapshot_create Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server self._domain.snapshotCreateXML(device_xml, flags=flags) Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server raise libvirtError('virDomainSnapshotCreateXML() failed') Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 25 04:42:32.973518 np0000003587 nova-compute[98952]: ERROR oslo_messaging.rpc.server Jun 25 04:42:33.225724 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:33.262121 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:33.288055 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Acquiring lock "54721bc9-c45c-4cb1-9910-f47334e84cd2" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:33.288248 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Lock "54721bc9-c45c-4cb1-9910-f47334e84cd2" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:33.375353 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:33.426092 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:33.428490 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:33.585811 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 25 04:42:33.792673 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Detaching volume 52af34af-1c56-4eb9-b8a7-a233eecc1da1 Jun 25 04:42:33.850263 np0000003587 nova-compute[98952]: INFO nova.virt.block_device [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Attempting to driver detach volume 52af34af-1c56-4eb9-b8a7-a233eecc1da1 from mountpoint /dev/vdb Jun 25 04:42:33.853971 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Found disk vdb by alias ua-52af34af-1c56-4eb9-b8a7-a233eecc1da1 {{(pid=98952) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 25 04:42:33.855449 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Found disk vdb by alias ua-52af34af-1c56-4eb9-b8a7-a233eecc1da1 {{(pid=98952) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 25 04:42:33.855717 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Attempting to detach device vdb from instance 54721bc9-c45c-4cb1-9910-f47334e84cd2 from the persistent domain config. {{(pid=98952) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 25 04:42:33.855971 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] detach device xml: Jun 25 04:42:33.855971 np0000003587 nova-compute[98952]: Jun 25 04:42:33.855971 np0000003587 nova-compute[98952]: Jun 25 04:42:33.855971 np0000003587 nova-compute[98952]: Jun 25 04:42:33.855971 np0000003587 nova-compute[98952]: Jun 25 04:42:33.855971 np0000003587 nova-compute[98952]: 52af34af-1c56-4eb9-b8a7-a233eecc1da1 Jun 25 04:42:33.855971 np0000003587 nova-compute[98952]:
Jun 25 04:42:33.855971 np0000003587 nova-compute[98952]: Jun 25 04:42:33.855971 np0000003587 nova-compute[98952]: {{(pid=98952) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 25 04:42:33.865139 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Successfully detached device vdb from instance 54721bc9-c45c-4cb1-9910-f47334e84cd2 from the persistent domain config. Jun 25 04:42:33.865310 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] (1/8): Attempting to detach device vdb with device alias ua-52af34af-1c56-4eb9-b8a7-a233eecc1da1 from instance 54721bc9-c45c-4cb1-9910-f47334e84cd2 from the live domain config. {{(pid=98952) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 25 04:42:33.865893 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] detach device xml: Jun 25 04:42:33.865893 np0000003587 nova-compute[98952]: Jun 25 04:42:33.865893 np0000003587 nova-compute[98952]: Jun 25 04:42:33.865893 np0000003587 nova-compute[98952]: Jun 25 04:42:33.865893 np0000003587 nova-compute[98952]: Jun 25 04:42:33.865893 np0000003587 nova-compute[98952]: 52af34af-1c56-4eb9-b8a7-a233eecc1da1 Jun 25 04:42:33.865893 np0000003587 nova-compute[98952]:
Jun 25 04:42:33.865893 np0000003587 nova-compute[98952]: Jun 25 04:42:33.865893 np0000003587 nova-compute[98952]: {{(pid=98952) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 25 04:42:34.228845 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Removed pending STOPPED event for 9aa3370c-9525-460d-b6fc-40a6461bd725 due to new event Resumed> {{(pid=98952) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 25 04:42:34.229885 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:42:34.230084 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] VM Resumed (Lifecycle Event) Jun 25 04:42:34.232341 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-3deadbdb-621e-4065-8cbf-2a2c327c3284 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:34.449431 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias ua-52af34af-1c56-4eb9-b8a7-a233eecc1da1 for instance 54721bc9-c45c-4cb1-9910-f47334e84cd2 {{(pid=98952) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 25 04:42:34.605593 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Found WWN 330000000f79aaea1 for multipath device dm-9 {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 25 04:42:34.605931 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:34.606107 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] <== connect_volume: return (4076ms) {'type': 'block', 'scsi_wwn': '330000000f79aaea1', 'path': '/dev/dm-9', 'multipath_id': '330000000f79aaea1'} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:42:34.606243 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f79aaea1', 'path': '/dev/dm-9', 'multipath_id': '330000000f79aaea1'} {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 25 04:42:34.609087 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.904s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:34.610536 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca', 'iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a3e10d6f-9ca6-4492-a73c-310434d013ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 25 04:42:34.610536 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca', 0)] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 25 04:42:34.612516 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lazy-loading 'flavor' on Instance uuid 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:34.650085 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:34.650085 np0000003587 nova-compute[98952]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:34.650085 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:34.650085 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:34.650085 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:34.650085 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:34.650085 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:34.650085 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:34.650085 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:34.650085 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:34.650085 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:34.650085 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:34.650085 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:34.650390 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:34.650390 np0000003587 nova-compute[98952]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:34.650390 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:34.650390 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:34.650390 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:34.650390 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:34.650390 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:34.650390 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:34.650390 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:34.650390 np0000003587 nova-compute[98952]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:34.650390 np0000003587 nova-compute[98952]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca (non-flash) Jun 25 04:42:34.650390 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:34.650390 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:34.650666 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1', '9')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 25 04:42:34.650758 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca', '7')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:42:34.654071 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca', '8')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:42:34.658074 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Resulting device map defaultdict(. at 0x7a16b015a0c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca'): ({'sdg'}, set())}) {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 25 04:42:34.658074 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Removing multipathed devices sdf, sdg {{(pid=98952) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 25 04:42:34.658074 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Flush multipath device 3300000001ddd21de {{(pid=98952) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 25 04:42:34.669101 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-08abefe8-1612-4e21-a003-d57fb392e61c req-4d8a9ab2-47d1-4017-81a2-1eae42cf6a9e service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Received event network-vif-unplugged-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:34.669713 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-08abefe8-1612-4e21-a003-d57fb392e61c req-4d8a9ab2-47d1-4017-81a2-1eae42cf6a9e service nova] Acquiring lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:34.669713 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-08abefe8-1612-4e21-a003-d57fb392e61c req-4d8a9ab2-47d1-4017-81a2-1eae42cf6a9e service nova] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:34.669713 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-08abefe8-1612-4e21-a003-d57fb392e61c req-4d8a9ab2-47d1-4017-81a2-1eae42cf6a9e service nova] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:34.669867 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-08abefe8-1612-4e21-a003-d57fb392e61c req-4d8a9ab2-47d1-4017-81a2-1eae42cf6a9e service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] No waiting events found dispatching network-vif-unplugged-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:42:34.670056 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-08abefe8-1612-4e21-a003-d57fb392e61c req-4d8a9ab2-47d1-4017-81a2-1eae42cf6a9e service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Received unexpected event network-vif-unplugged-62e285cd-c2d8-4883-a400-d57367b20980 for instance with vm_state active and task_state None. Jun 25 04:42:34.670143 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-08abefe8-1612-4e21-a003-d57fb392e61c req-4d8a9ab2-47d1-4017-81a2-1eae42cf6a9e service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Received event network-vif-plugged-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:34.670298 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-08abefe8-1612-4e21-a003-d57fb392e61c req-4d8a9ab2-47d1-4017-81a2-1eae42cf6a9e service nova] Acquiring lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:34.670436 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-08abefe8-1612-4e21-a003-d57fb392e61c req-4d8a9ab2-47d1-4017-81a2-1eae42cf6a9e service nova] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:34.670708 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-08abefe8-1612-4e21-a003-d57fb392e61c req-4d8a9ab2-47d1-4017-81a2-1eae42cf6a9e service nova] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:34.671088 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-08abefe8-1612-4e21-a003-d57fb392e61c req-4d8a9ab2-47d1-4017-81a2-1eae42cf6a9e service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] No waiting events found dispatching network-vif-plugged-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:42:34.671229 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-08abefe8-1612-4e21-a003-d57fb392e61c req-4d8a9ab2-47d1-4017-81a2-1eae42cf6a9e service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Received unexpected event network-vif-plugged-62e285cd-c2d8-4883-a400-d57367b20980 for instance with vm_state active and task_state None. Jun 25 04:42:34.671439 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-08abefe8-1612-4e21-a003-d57fb392e61c req-4d8a9ab2-47d1-4017-81a2-1eae42cf6a9e service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Received event network-vif-plugged-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:34.671535 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-08abefe8-1612-4e21-a003-d57fb392e61c req-4d8a9ab2-47d1-4017-81a2-1eae42cf6a9e service nova] Acquiring lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:34.671776 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-08abefe8-1612-4e21-a003-d57fb392e61c req-4d8a9ab2-47d1-4017-81a2-1eae42cf6a9e service nova] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:34.671917 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-08abefe8-1612-4e21-a003-d57fb392e61c req-4d8a9ab2-47d1-4017-81a2-1eae42cf6a9e service nova] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:34.672056 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-08abefe8-1612-4e21-a003-d57fb392e61c req-4d8a9ab2-47d1-4017-81a2-1eae42cf6a9e service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] No waiting events found dispatching network-vif-plugged-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:42:34.672214 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-08abefe8-1612-4e21-a003-d57fb392e61c req-4d8a9ab2-47d1-4017-81a2-1eae42cf6a9e service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Received unexpected event network-vif-plugged-62e285cd-c2d8-4883-a400-d57367b20980 for instance with vm_state active and task_state None. Jun 25 04:42:34.689473 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:42:34.734086 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:34.735639 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:42:34.739609 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:42:34.787534 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 25 04:42:34.787800 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 25 04:42:34.792386 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 25 04:42:34.805145 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 25 04:42:34.805575 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca')] {{(pid=98952) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 25 04:42:34.816516 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:34.851260 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca, portal: 192.168.40.100,3260] Jun 25 04:42:34.851260 np0000003587 nova-compute[98952]: Logout of [sid: 7, target: iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca, portal: 192.168.40.100,3260] successful. Jun 25 04:42:34.851260 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:34.857652 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:34.870922 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:34.884474 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:34.928938 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca, portal: 192.168.50.100,3260] Jun 25 04:42:34.928938 np0000003587 nova-compute[98952]: Logout of [sid: 8, target: iqn.2023-03.storpool.com:os--volume-a3e10d6f-9ca6-4492-a73c-310434d013ca, portal: 192.168.50.100,3260] successful. Jun 25 04:42:34.928938 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:34.948763 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:34.949037 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:34.949149 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] <== disconnect_volume: return (4246ms) None {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:42:34.949291 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Disconnected iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 25 04:42:34.951283 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.876s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:34.951659 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 25 04:42:34.966161 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:34.966161 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:34.966854 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:34.967226 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:42:34.967724 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:34.968028 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:42:34.983389 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:42:34.983389 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:34.990370 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:42:34.990370 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:35.001231 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf] added Jun 25 04:42:35.001231 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:42:35.001231 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:42:35.001231 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:42:35.001231 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:42:35.001231 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:42:35.001231 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:35.001231 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:42:35.001231 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0325(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:42:35.001231 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:42:35.005729 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf] added Jun 25 04:42:35.005729 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:42:35.005729 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:42:35.005729 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:42:35.005729 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:42:35.005729 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:42:35.005729 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:35.005989 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:42:35.006048 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0381(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:42:35.006259 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:42:35.116853 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Attempting to attach volume 9ed8d9ce-b06c-4856-91a6-090a64fd59c4 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98952) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 25 04:42:35.118791 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] attach device xml: Jun 25 04:42:35.118791 np0000003587 nova-compute[98952]: Jun 25 04:42:35.118791 np0000003587 nova-compute[98952]: Jun 25 04:42:35.118791 np0000003587 nova-compute[98952]: Jun 25 04:42:35.118791 np0000003587 nova-compute[98952]: Jun 25 04:42:35.118791 np0000003587 nova-compute[98952]: 9ed8d9ce-b06c-4856-91a6-090a64fd59c4 Jun 25 04:42:35.118791 np0000003587 nova-compute[98952]: Jun 25 04:42:35.118791 np0000003587 nova-compute[98952]: Jun 25 04:42:35.118791 np0000003587 nova-compute[98952]: {{(pid=98952) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 25 04:42:35.243764 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:42:35.244185 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] VM Started (Lifecycle Event) Jun 25 04:42:35.550297 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lazy-loading 'flavor' on Instance uuid 5e52bd75-8566-4472-8147-99655013bc83 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:35.748403 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:35.752659 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:42:36.000227 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:42:36.006760 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.50.100 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:42:36.016866 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.40.100 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:42:36.028246 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:36.030929 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:36.047006 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:36.059341 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:36.059341 np0000003587 nova-compute[98952]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:36.059341 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:36.059341 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:36.059341 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:36.059341 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:36.059341 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:36.059341 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:36.059341 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:36.059341 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:36.059341 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:36.060001 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:36.060001 np0000003587 nova-compute[98952]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:36.060001 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:36.060001 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:36.060001 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:36.060001 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:36.060001 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:36.060001 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:36.060001 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:36.060001 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:36.060001 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:36.074767 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:36.074767 np0000003587 nova-compute[98952]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:36.074767 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:36.074767 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:36.074767 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:36.074767 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:36.074767 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:36.074767 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:36.074767 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:36.074767 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:36.074767 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:36.075813 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:36.075813 np0000003587 nova-compute[98952]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:36.075813 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:36.075813 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:36.075813 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:36.075813 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:36.075813 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:36.075813 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:36.075813 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:36.075813 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:36.075813 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:36.118531 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf, portal: 192.168.50.100,3260] Jun 25 04:42:36.118531 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf, portal: 192.168.50.100,3260] successful. Jun 25 04:42:36.118531 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:36.131500 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:36.132108 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf, portal: 192.168.40.100,3260] Jun 25 04:42:36.132108 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf, portal: 192.168.40.100,3260] successful. Jun 25 04:42:36.132108 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:36.147040 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:36.152094 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:36.152094 np0000003587 nova-compute[98952]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:36.152094 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:36.152094 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:36.152094 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:36.152094 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:36.152094 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:36.152094 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:36.152094 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:36.152094 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:36.152094 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:36.152094 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:36.152094 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:36.152448 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:36.152448 np0000003587 nova-compute[98952]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:36.152448 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:36.152448 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:36.152448 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:36.152448 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:36.152448 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:36.152448 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:36.152448 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:36.152448 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:36.152448 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:36.152448 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:36.152448 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:36.152821 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.186s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:36.153252 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Connected to 192.168.50.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:42:36.154546 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] HCTL ('11', '-', '-', 0) found on session 15 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:42:36.154752 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:42:36.167284 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:36.167284 np0000003587 nova-compute[98952]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:36.167284 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:36.167284 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:36.167284 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:36.167284 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:36.167284 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:36.167284 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:36.167284 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:36.167284 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:36.167284 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:36.167284 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:36.167284 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:36.167769 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:36.167769 np0000003587 nova-compute[98952]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:36.167769 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:36.167769 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:36.167769 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:36.167769 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:36.167769 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:36.167769 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:36.167769 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:36.167769 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:36.167769 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:36.167769 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:36.167769 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:36.167769 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.200s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:36.167769 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Connected to 192.168.40.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:42:36.169024 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] HCTL ('12', '-', '-', 0) found on session 16 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:42:36.169024 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:42:36.175002 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Searching for a device in session 15 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:42:36.175129 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:42:36.185010 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Searching for a device in session 16 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:42:36.185010 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:42:36.240969 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "1b412363-2fb7-4469-b748-80cc52825bb5" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:36.240969 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "1b412363-2fb7-4469-b748-80cc52825bb5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:36.256907 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Received event ua-52af34af-1c56-4eb9-b8a7-a233eecc1da1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98952) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 25 04:42:36.260196 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Successfully detached device vdb from instance 54721bc9-c45c-4cb1-9910-f47334e84cd2 from the live domain config. Jun 25 04:42:36.262828 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] calling os-brick to detach iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 25 04:42:36.262828 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1', 'iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '52af34af-1c56-4eb9-b8a7-a233eecc1da1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:42:36.262828 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:36.304999 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:36.564445 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-332eaea5-7e57-4eac-b854-27e50bc7324d tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "5e52bd75-8566-4472-8147-99655013bc83" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 6.704s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:36.644001 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Acquiring lock "775ef107-e7ca-4d94-b5ab-2ec8665a4906" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:36.644296 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "775ef107-e7ca-4d94-b5ab-2ec8665a4906" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:36.744641 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:42:36.792358 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:42:36.794576 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:42:36.794576 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:42:36.794576 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No VIF found with MAC fa:16:3e:3a:48:58, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:42:36.967221 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 25 04:42:37.146801 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:42:37.311969 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:37.311969 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:37.315772 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:42:37.316019 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Claim successful on node np0000003587 Jun 25 04:42:37.577064 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:37.577316 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:37.701716 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:37.829052 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-15f152ae-8589-4dc4-afa9-b7132c575a18 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Acquiring lock "5e52bd75-8566-4472-8147-99655013bc83" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:37.829211 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-15f152ae-8589-4dc4-afa9-b7132c575a18 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "5e52bd75-8566-4472-8147-99655013bc83" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:37.829405 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-15f152ae-8589-4dc4-afa9-b7132c575a18 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Acquiring lock "5e52bd75-8566-4472-8147-99655013bc83-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:37.829531 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-15f152ae-8589-4dc4-afa9-b7132c575a18 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "5e52bd75-8566-4472-8147-99655013bc83-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:37.829727 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-15f152ae-8589-4dc4-afa9-b7132c575a18 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "5e52bd75-8566-4472-8147-99655013bc83-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:37.834309 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-15f152ae-8589-4dc4-afa9-b7132c575a18 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Terminating instance Jun 25 04:42:37.982358 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Found WWN 330000000cc189752 for multipath device dm-4 {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 25 04:42:37.982656 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:37.982872 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] <== connect_volume: return (5907ms) {'type': 'block', 'scsi_wwn': '330000000cc189752', 'path': '/dev/dm-4', 'multipath_id': '330000000cc189752'} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:42:37.983018 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cc189752', 'path': '/dev/dm-4', 'multipath_id': '330000000cc189752'} {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 25 04:42:37.983498 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.721s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:37.983857 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1', 'iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '52af34af-1c56-4eb9-b8a7-a233eecc1da1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 25 04:42:37.984137 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1', 0)] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 25 04:42:38.016366 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:38.016366 np0000003587 nova-compute[98952]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:38.016366 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:38.016366 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:38.016366 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:38.016366 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:38.016366 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:38.016366 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:38.016366 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:38.016366 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:38.016366 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:38.016366 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:38.016366 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:38.017116 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:38.017116 np0000003587 nova-compute[98952]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:38.017116 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:38.017116 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:38.017116 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:38.017116 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:38.017116 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:38.017116 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:38.017116 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:38.017116 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:38.017116 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:38.017116 np0000003587 nova-compute[98952]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1 (non-flash) Jun 25 04:42:38.017116 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:38.017451 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', '15'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1', '9')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 25 04:42:38.017451 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1', '10')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:42:38.018541 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1', '9')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:42:38.019545 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Resulting device map defaultdict(. at 0x7a16b0158a40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1'): ({'sdi'}, set())}) {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 25 04:42:38.019768 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Removing multipathed devices sdh, sdi {{(pid=98952) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 25 04:42:38.019965 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Flush multipath device 33000000080a5b275 {{(pid=98952) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 25 04:42:38.059460 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:42:38.080609 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:42:38.105236 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:42:38.162477 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 25 04:42:38.162926 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] SCSI volumes sdh, sdi have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 25 04:42:38.164013 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 25 04:42:38.175583 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 25 04:42:38.175583 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1')] {{(pid=98952) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 25 04:42:38.185789 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:38.226723 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1, portal: 192.168.40.100,3260] Jun 25 04:42:38.226723 np0000003587 nova-compute[98952]: Logout of [sid: 10, target: iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1, portal: 192.168.40.100,3260] successful. Jun 25 04:42:38.226723 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:38.254826 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:38.273795 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:38.315353 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1, portal: 192.168.50.100,3260] Jun 25 04:42:38.315353 np0000003587 nova-compute[98952]: Logout of [sid: 9, target: iqn.2023-03.storpool.com:os--volume-52af34af-1c56-4eb9-b8a7-a233eecc1da1, portal: 192.168.50.100,3260] successful. Jun 25 04:42:38.315353 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:38.339199 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:38.339450 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:38.339641 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] <== disconnect_volume: return (2076ms) None {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:42:38.339870 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Disconnected iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 25 04:42:38.341782 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-15f152ae-8589-4dc4-afa9-b7132c575a18 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Start destroying the instance on the hypervisor. {{(pid=98952) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 25 04:42:38.365162 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:38.376017 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:38.378578 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-c3ed7850-4c11-45dd-9ce9-e7f048b00815 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 8.693s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:38.396507 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:38.397383 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:38.426192 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:38.489015 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Calling os-brick to attach iSCSI Volume {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 25 04:42:38.489356 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cc7be47d-8d0a-4286-86d2-621b59df6075', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:42:38.489534 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:38.489939 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:38.490226 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cc7be47d-8d0a-4286-86d2-621b59df6075', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 25 04:42:38.505689 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:38.506641 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:38.507478 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:38.507691 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:42:38.508238 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:38.508501 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:42:38.520391 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:42:38.520391 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:38.526014 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:42:38.526014 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:38.536001 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075] added Jun 25 04:42:38.536001 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:42:38.536001 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:42:38.536001 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:42:38.536001 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:42:38.536001 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:42:38.536001 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:38.536411 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:42:38.537149 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0288(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:42:38.537149 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:42:38.539418 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075] added Jun 25 04:42:38.539418 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:42:38.539418 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:42:38.539418 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:42:38.539418 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:42:38.539418 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:42:38.539418 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:38.539810 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:42:38.539876 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0314(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:42:38.540007 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:42:38.573436 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-3d7136e8-9761-4b4a-a1ae-38cda9317b2a req-4c51c6c9-0f83-4e80-8822-e8f9b1dc85b2 service nova] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Received event network-vif-unplugged-816a6c6d-d655-46f8-9f8e-7b6bde2e2e50 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:38.573634 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-3d7136e8-9761-4b4a-a1ae-38cda9317b2a req-4c51c6c9-0f83-4e80-8822-e8f9b1dc85b2 service nova] Acquiring lock "5e52bd75-8566-4472-8147-99655013bc83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:38.573796 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-3d7136e8-9761-4b4a-a1ae-38cda9317b2a req-4c51c6c9-0f83-4e80-8822-e8f9b1dc85b2 service nova] Lock "5e52bd75-8566-4472-8147-99655013bc83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:38.573921 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-3d7136e8-9761-4b4a-a1ae-38cda9317b2a req-4c51c6c9-0f83-4e80-8822-e8f9b1dc85b2 service nova] Lock "5e52bd75-8566-4472-8147-99655013bc83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:38.574067 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-3d7136e8-9761-4b4a-a1ae-38cda9317b2a req-4c51c6c9-0f83-4e80-8822-e8f9b1dc85b2 service nova] [instance: 5e52bd75-8566-4472-8147-99655013bc83] No waiting events found dispatching network-vif-unplugged-816a6c6d-d655-46f8-9f8e-7b6bde2e2e50 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:42:38.574718 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-3d7136e8-9761-4b4a-a1ae-38cda9317b2a req-4c51c6c9-0f83-4e80-8822-e8f9b1dc85b2 service nova] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Received event network-vif-unplugged-816a6c6d-d655-46f8-9f8e-7b6bde2e2e50 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:42:38.665314 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:38.679017 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:38.683147 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:38.710236 np0000003587 nova-compute[98952]: DEBUG nova.utils [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Queued Task(fn=>, remaining_delay=14.99967963600011 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:42:38.711735 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Instance destroyed successfully. Jun 25 04:42:38.712206 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-15f152ae-8589-4dc4-afa9-b7132c575a18 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lazy-loading 'resources' on Instance uuid 5e52bd75-8566-4472-8147-99655013bc83 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:38.951586 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Lazy-loading 'flavor' on Instance uuid 54721bc9-c45c-4cb1-9910-f47334e84cd2 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:38.984406 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "19180a23-a7e0-4354-b9f4-9ca57062fc06" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:38.986841 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "19180a23-a7e0-4354-b9f4-9ca57062fc06" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:39.073510 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:42:39.073895 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:42:39.214776 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-15f152ae-8589-4dc4-afa9-b7132c575a18 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:41:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-613777004',display_name='tempest-AttachSCSIVolumeTestJSON-server-613777004',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-attachscsivolumetestjson-server-613777004',id=3,image_ref='19d144f4-084b-4c62-939d-d67ccdaa4e70',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/k7W/rtELyUz1iF31cO7RdB38ezlqBtbGQf36FILgd3CDfqTLhbMDKey6+yc4KTSXPFFzyA52GnMjminrBjWhcDoU0ftyPqPHkA6d05HiQr/RvAPH4Jx1yrBqInelmzg==',key_name='tempest-keypair-1598629308',keypairs=,launch_index=0,launched_at=2026-06-25T04:41:36Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='6c31b6cf6f5f4fff90914e329442d042',ramdisk_id='',reservation_id='r-h6hb1bk4',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d144f4-084b-4c62-939d-d67ccdaa4e70',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-717482791',owner_user_name='tempest-AttachSCSIVolumeTestJSON-717482791-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:41:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='653ba57c4bcc479ea05a45ac7b213b1e',uuid=5e52bd75-8566-4472-8147-99655013bc83,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "816a6c6d-d655-46f8-9f8e-7b6bde2e2e50", "address": "fa:16:3e:5d:a0:ff", "network": {"id": "0c192e32-6947-44e6-b8c5-07d6f5f711af", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-940608449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c31b6cf6f5f4fff90914e329442d042", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap816a6c6d-d6", "ovs_interfaceid": "816a6c6d-d655-46f8-9f8e-7b6bde2e2e50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:42:39.215464 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-15f152ae-8589-4dc4-afa9-b7132c575a18 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Converting VIF {"id": "816a6c6d-d655-46f8-9f8e-7b6bde2e2e50", "address": "fa:16:3e:5d:a0:ff", "network": {"id": "0c192e32-6947-44e6-b8c5-07d6f5f711af", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-940608449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6c31b6cf6f5f4fff90914e329442d042", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap816a6c6d-d6", "ovs_interfaceid": "816a6c6d-d655-46f8-9f8e-7b6bde2e2e50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:42:39.215808 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-15f152ae-8589-4dc4-afa9-b7132c575a18 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:a0:ff,bridge_name='br-int',has_traffic_filtering=True,id=816a6c6d-d655-46f8-9f8e-7b6bde2e2e50,network=Network(0c192e32-6947-44e6-b8c5-07d6f5f711af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap816a6c6d-d6') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:42:39.216061 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-15f152ae-8589-4dc4-afa9-b7132c575a18 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:a0:ff,bridge_name='br-int',has_traffic_filtering=True,id=816a6c6d-d655-46f8-9f8e-7b6bde2e2e50,network=Network(0c192e32-6947-44e6-b8c5-07d6f5f711af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap816a6c6d-d6') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:42:39.220272 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:39.220698 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap816a6c6d-d6, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:39.222478 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:39.223373 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:39.228426 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:39.228426 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eee0b3e1-b0f8-4d46-b1a8-8fcfc3467a27) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:39.229056 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:39.229834 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:39.230877 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:39.233344 np0000003587 nova-compute[98952]: INFO os_vif [None req-15f152ae-8589-4dc4-afa9-b7132c575a18 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:a0:ff,bridge_name='br-int',has_traffic_filtering=True,id=816a6c6d-d655-46f8-9f8e-7b6bde2e2e50,network=Network(0c192e32-6947-44e6-b8c5-07d6f5f711af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap816a6c6d-d6') Jun 25 04:42:39.233887 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-15f152ae-8589-4dc4-afa9-b7132c575a18 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Deleting instance files /opt/stack/data/nova/instances/5e52bd75-8566-4472-8147-99655013bc83_del Jun 25 04:42:39.234783 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-15f152ae-8589-4dc4-afa9-b7132c575a18 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Deletion of /opt/stack/data/nova/instances/5e52bd75-8566-4472-8147-99655013bc83_del complete Jun 25 04:42:39.489344 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lazy-loading 'flavor' on Instance uuid 19180a23-a7e0-4354-b9f4-9ca57062fc06 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:39.537209 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:42:39.541713 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.40.100 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:42:39.550282 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.50.100 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:42:39.554933 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:39.564772 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:39.570538 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:39.576858 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:42:39.585371 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:39.585371 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:39.585371 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:39.585371 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:39.585371 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:39.585371 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:39.585371 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:39.585371 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:39.585371 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:39.585371 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:39.585371 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:39.585861 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:39.585861 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:39.585861 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:39.585861 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:39.585861 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:39.585861 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:39.585861 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:39.585861 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:39.585861 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:39.585861 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:39.585861 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:39.589701 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:39.589701 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:39.589701 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:39.589701 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:39.589701 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:39.589701 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:39.589701 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:39.589701 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:39.589701 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:39.589701 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:39.589701 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:39.589979 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:39.589979 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:39.589979 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:39.589979 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:39.589979 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:39.589979 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:39.589979 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:39.589979 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:39.589979 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:39.589979 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:39.589979 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:39.635301 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075, portal: 192.168.40.100,3260] Jun 25 04:42:39.635301 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075, portal: 192.168.40.100,3260] successful. Jun 25 04:42:39.635301 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:39.645237 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075, portal: 192.168.50.100,3260] Jun 25 04:42:39.645237 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075, portal: 192.168.50.100,3260] successful. Jun 25 04:42:39.645237 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:39.646744 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:39.657793 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:39.670251 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:39.670251 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:39.670251 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:39.670251 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:39.670251 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:39.670251 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:39.670251 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:42:39.670251 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:42:39.670251 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:39.670251 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:39.670251 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:39.670251 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:39.670251 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:39.670674 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:39.670674 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:39.670674 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:39.670674 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:39.670674 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:39.670674 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:39.670674 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:42:39.670674 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:42:39.670674 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:39.670674 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:39.670674 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:39.670674 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:39.670674 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:39.670674 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:39.671057 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Connected to 192.168.40.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:42:39.671810 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] HCTL ('13', '-', '-', 0) found on session 17 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:42:39.671905 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:42:39.676375 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:39.676375 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:39.676375 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:39.676375 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:39.676375 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:39.676375 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:39.676375 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:42:39.676375 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:42:39.676375 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:39.676375 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:39.676375 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:39.676375 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:39.676375 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:39.676802 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:39.676802 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:39.676802 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:39.676802 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:39.676802 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:39.676802 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:39.676802 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:42:39.676802 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:42:39.676802 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:39.676802 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:39.676802 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:39.676802 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:39.676802 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:39.676802 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:39.677106 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Connected to 192.168.50.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:42:39.677770 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] HCTL ('14', '-', '-', 0) found on session 18 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:42:39.677865 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:42:39.687421 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Searching for a device in session 17 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:42:39.687421 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cc7be47d-8d0a-4286-86d2-621b59df6075', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:42:39.696182 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Searching for a device in session 18 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:42:39.696182 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'cc7be47d-8d0a-4286-86d2-621b59df6075', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:42:39.740260 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-15f152ae-8589-4dc4-afa9-b7132c575a18 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Took 1.40 seconds to destroy the instance on the hypervisor. Jun 25 04:42:39.740721 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._common.loopingcall [None req-15f152ae-8589-4dc4-afa9-b7132c575a18 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98952) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 25 04:42:39.740874 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [-] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Deallocating network for instance {{(pid=98952) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 25 04:42:39.740968 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: 5e52bd75-8566-4472-8147-99655013bc83] deallocate_for_instance() {{(pid=98952) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 25 04:42:39.741181 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:39.849782 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:39.859890 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:39.956129 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-c30038d6-6aef-4d87-93f2-752a1264e5a5 tempest-VolumesAssistedSnapshotsTest-271892586 tempest-VolumesAssistedSnapshotsTest-271892586-project-admin] Lock "54721bc9-c45c-4cb1-9910-f47334e84cd2" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 6.668s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:40.049104 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:42:40.049408 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:42:40.049694 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:42:40.049935 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:42:40.050175 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:42:40.050317 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:42:40.050505 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:42:40.050742 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:42:40.050901 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98952) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 25 04:42:40.051095 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:42:40.087922 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.776s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:40.089304 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.387s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:40.089550 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:42:40.094677 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:42:40.094870 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Claim successful on node np0000003587 Jun 25 04:42:40.495663 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "19180a23-a7e0-4354-b9f4-9ca57062fc06" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.510s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:40.508061 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 25 04:42:40.518786 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-0ea27be8-ef5d-4fc5-9035-9f42e975bad4 req-a848dec6-b90b-4e9f-a32f-3567bfa0307e service nova] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Received event network-vif-deleted-816a6c6d-d655-46f8-9f8e-7b6bde2e2e50 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:40.521955 np0000003587 nova-compute[98952]: INFO nova.compute.manager [req-0ea27be8-ef5d-4fc5-9035-9f42e975bad4 req-a848dec6-b90b-4e9f-a32f-3567bfa0307e service nova] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Neutron deleted interface 816a6c6d-d655-46f8-9f8e-7b6bde2e2e50; detaching it from the instance and deleting it from the info cache Jun 25 04:42:40.524155 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-0ea27be8-ef5d-4fc5-9035-9f42e975bad4 req-a848dec6-b90b-4e9f-a32f-3567bfa0307e service nova] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Detach interface failed, port_id=816a6c6d-d655-46f8-9f8e-7b6bde2e2e50, reason: Instance 5e52bd75-8566-4472-8147-99655013bc83 could not be found. {{(pid=98952) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 25 04:42:40.555724 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:40.595627 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:42:40.595827 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:42:40.596145 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:40.596526 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:40.671593 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-5d364863-2383-46c4-890e-ea96d9535a99 req-7f306046-384f-4d7c-878f-74cb9ae7eb32 service nova] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Received event network-vif-unplugged-816a6c6d-d655-46f8-9f8e-7b6bde2e2e50 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:40.671593 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-5d364863-2383-46c4-890e-ea96d9535a99 req-7f306046-384f-4d7c-878f-74cb9ae7eb32 service nova] Acquiring lock "5e52bd75-8566-4472-8147-99655013bc83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:40.671593 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-5d364863-2383-46c4-890e-ea96d9535a99 req-7f306046-384f-4d7c-878f-74cb9ae7eb32 service nova] Lock "5e52bd75-8566-4472-8147-99655013bc83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:40.671593 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-5d364863-2383-46c4-890e-ea96d9535a99 req-7f306046-384f-4d7c-878f-74cb9ae7eb32 service nova] Lock "5e52bd75-8566-4472-8147-99655013bc83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:40.671593 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-5d364863-2383-46c4-890e-ea96d9535a99 req-7f306046-384f-4d7c-878f-74cb9ae7eb32 service nova] [instance: 5e52bd75-8566-4472-8147-99655013bc83] No waiting events found dispatching network-vif-unplugged-816a6c6d-d655-46f8-9f8e-7b6bde2e2e50 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:42:40.671593 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-5d364863-2383-46c4-890e-ea96d9535a99 req-7f306046-384f-4d7c-878f-74cb9ae7eb32 service nova] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Received event network-vif-unplugged-816a6c6d-d655-46f8-9f8e-7b6bde2e2e50 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:42:40.716811 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27ebe4b23b624995a52b9313ff9e318a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d52ed3b8de460eb65a8fb4ad1b015d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:42:40.956803 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:41.098515 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 25 04:42:41.222169 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Successfully created port: 53b9a3dd-c125-4e7b-b3ee-9debd47394dd {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:42:41.459186 np0000003587 nova-compute[98952]: INFO nova.compute.manager [-] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Took 1.72 seconds to deallocate network for instance. Jun 25 04:42:41.533545 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Found WWN 330000000780d26f6 for multipath device dm-5 {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 25 04:42:41.534090 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:41.534090 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] <== connect_volume: return (3044ms) {'type': 'block', 'scsi_wwn': '330000000780d26f6', 'path': '/dev/dm-5', 'multipath_id': '330000000780d26f6'} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:42:41.534090 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000780d26f6', 'path': '/dev/dm-5', 'multipath_id': '330000000780d26f6'} {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 25 04:42:41.588243 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "19180a23-a7e0-4354-b9f4-9ca57062fc06" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:41.588441 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "19180a23-a7e0-4354-b9f4-9ca57062fc06" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:41.588682 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Attaching volume 9ed8d9ce-b06c-4856-91a6-090a64fd59c4 to /dev/vdb Jun 25 04:42:41.601308 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Start building block device mappings for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 25 04:42:41.655423 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.80', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003587', 'execute': None}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:42:41.668237 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.scaleio [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98952) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 25 04:42:41.695761 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): nvme version {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:41.726888 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] 'nvme version' failed. Not Retrying. {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 04:42:41.727289 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] nvme not present on system {{(pid=98952) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 25 04:42:41.735639 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98952) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 25 04:42:41.737991 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.lightos [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Current host hostNQN and IP(s) are ['10.4.3.80', 'fe80::f816:3eff:feea:dfe4', '192.168.40.6', 'fe80::f816:3eff:fe4f:7c42', '192.168.50.6', 'fe80::f816:3eff:fe6c:e6a6', '192.168.10.6', 'fe80::f816:3eff:fe17:d749', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::b035:28ff:fe70:6f4a', 'fe80::fc16:3eff:fe8c:f883', 'fe80::483f:f2ff:fe48:75ca', 'fe80::fc16:3eff:fe78:7ac8', 'fe80::1038:1dff:fe1c:d44b', 'fe80::fc16:3eff:feb0:e88f', 'fe80::5c81:6cff:fe82:5221', 'fe80::fc16:3eff:fe3a:4858', 'fe80::fc16:3eff:fe4f:4083', 'fe80::fc16:3eff:fee6:e022'] Jun 25 04:42:41.737991 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 25 04:42:41.737991 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] LIGHTOS: no hostnqn found. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 25 04:42:41.737991 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.80', 'host': 'np0000003587', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c81886224652', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a1feb13-40e2-4ac6-989e-b08a6fc0f283', 'nvme_native_multipath': False} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:42:41.737991 np0000003587 nova-compute[98952]: DEBUG nova.virt.block_device [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Updating existing volume attachment record: f70f6217-768c-45fb-8a1a-3235b7475b2a {{(pid=98952) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 25 04:42:41.814530 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:42:41.814753 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:42:41.834438 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Successfully updated port: 53b9a3dd-c125-4e7b-b3ee-9debd47394dd {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:42:41.909963 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-3c262e19-7950-4c18-9f33-f8af87915688 req-0a909de7-4756-4a48-8827-ff51952afa07 service nova] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Received event network-changed-53b9a3dd-c125-4e7b-b3ee-9debd47394dd {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:41.910100 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-3c262e19-7950-4c18-9f33-f8af87915688 req-0a909de7-4756-4a48-8827-ff51952afa07 service nova] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Refreshing instance network info cache due to event network-changed-53b9a3dd-c125-4e7b-b3ee-9debd47394dd. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:42:41.910272 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-3c262e19-7950-4c18-9f33-f8af87915688 req-0a909de7-4756-4a48-8827-ff51952afa07 service nova] Acquiring lock "refresh_cache-1b412363-2fb7-4469-b748-80cc52825bb5" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:41.910357 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-3c262e19-7950-4c18-9f33-f8af87915688 req-0a909de7-4756-4a48-8827-ff51952afa07 service nova] Acquired lock "refresh_cache-1b412363-2fb7-4469-b748-80cc52825bb5" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:42:41.910473 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-3c262e19-7950-4c18-9f33-f8af87915688 req-0a909de7-4756-4a48-8827-ff51952afa07 service nova] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Refreshing network info cache for port 53b9a3dd-c125-4e7b-b3ee-9debd47394dd {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:42:41.964862 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-15f152ae-8589-4dc4-afa9-b7132c575a18 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:42.021837 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ba25a7e8-a1f6-417f-a4dc-3805ad5eaecc tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Acquiring lock "54721bc9-c45c-4cb1-9910-f47334e84cd2" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:42.021965 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ba25a7e8-a1f6-417f-a4dc-3805ad5eaecc tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Lock "54721bc9-c45c-4cb1-9910-f47334e84cd2" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:42.022144 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ba25a7e8-a1f6-417f-a4dc-3805ad5eaecc tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Acquiring lock "54721bc9-c45c-4cb1-9910-f47334e84cd2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:42.022279 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ba25a7e8-a1f6-417f-a4dc-3805ad5eaecc tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Lock "54721bc9-c45c-4cb1-9910-f47334e84cd2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:42.022378 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ba25a7e8-a1f6-417f-a4dc-3805ad5eaecc tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Lock "54721bc9-c45c-4cb1-9910-f47334e84cd2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:42.024507 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-ba25a7e8-a1f6-417f-a4dc-3805ad5eaecc tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Terminating instance Jun 25 04:42:42.039529 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1434404356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-1434404356',id=8,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5fI7yNY+vtWfP6sAEqW81Ob/M0+caqTNEaqf66GbJOFzQ10yeZKXCZkAEA1454wRog9bgRijpgzGKf9EXrMHobXUkpq6fgIwY7w+jABzxBMefwpq8P4Wvi0vvmcHxoKQ==',key_name='tempest-keypair-1601168903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c1a4dead6ad4de1bb75262d9c52bbee',ramdisk_id='',reservation_id='r-gtp0jtk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-479660225',owner_user_name='tempest-TaggedBootDevicesTest_v242-479660225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be344ec982ae4676b6a89325d3578d73',uuid=9c033870-f167-4235-86ff-98005452a16c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e12da27e-2953-4784-80b6-5f7204f4e399", "address": "fa:16:3e:ab:c3:d8", "network": {"id": "179999b1-f8ab-4073-96b7-da830d110303", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1298382094-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape12da27e-29", "ovs_interfaceid": "e12da27e-2953-4784-80b6-5f7204f4e399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:42:42.040468 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converting VIF {"id": "e12da27e-2953-4784-80b6-5f7204f4e399", "address": "fa:16:3e:ab:c3:d8", "network": {"id": "179999b1-f8ab-4073-96b7-da830d110303", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1298382094-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape12da27e-29", "ovs_interfaceid": "e12da27e-2953-4784-80b6-5f7204f4e399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:42:42.041402 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c3:d8,bridge_name='br-int',has_traffic_filtering=True,id=e12da27e-2953-4784-80b6-5f7204f4e399,network=Network(179999b1-f8ab-4073-96b7-da830d110303),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape12da27e-29') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:42:42.042317 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1434404356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-1434404356',id=8,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5fI7yNY+vtWfP6sAEqW81Ob/M0+caqTNEaqf66GbJOFzQ10yeZKXCZkAEA1454wRog9bgRijpgzGKf9EXrMHobXUkpq6fgIwY7w+jABzxBMefwpq8P4Wvi0vvmcHxoKQ==',key_name='tempest-keypair-1601168903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c1a4dead6ad4de1bb75262d9c52bbee',ramdisk_id='',reservation_id='r-gtp0jtk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-479660225',owner_user_name='tempest-TaggedBootDevicesTest_v242-479660225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be344ec982ae4676b6a89325d3578d73',uuid=9c033870-f167-4235-86ff-98005452a16c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e8846aa-559c-48a1-bf9a-ab431fd380ed", "address": "fa:16:3e:6d:cc:4e", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8846aa-55", "ovs_interfaceid": "7e8846aa-559c-48a1-bf9a-ab431fd380ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:42:42.042492 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converting VIF {"id": "7e8846aa-559c-48a1-bf9a-ab431fd380ed", "address": "fa:16:3e:6d:cc:4e", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8846aa-55", "ovs_interfaceid": "7e8846aa-559c-48a1-bf9a-ab431fd380ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:42:42.042945 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:cc:4e,bridge_name='br-int',has_traffic_filtering=True,id=7e8846aa-559c-48a1-bf9a-ab431fd380ed,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e8846aa-55') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:42:42.043673 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1434404356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-1434404356',id=8,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5fI7yNY+vtWfP6sAEqW81Ob/M0+caqTNEaqf66GbJOFzQ10yeZKXCZkAEA1454wRog9bgRijpgzGKf9EXrMHobXUkpq6fgIwY7w+jABzxBMefwpq8P4Wvi0vvmcHxoKQ==',key_name='tempest-keypair-1601168903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c1a4dead6ad4de1bb75262d9c52bbee',ramdisk_id='',reservation_id='r-gtp0jtk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-479660225',owner_user_name='tempest-TaggedBootDevicesTest_v242-479660225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be344ec982ae4676b6a89325d3578d73',uuid=9c033870-f167-4235-86ff-98005452a16c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d1f24c3-d7a8-450a-92d5-0e807355b791", "address": "fa:16:3e:07:d0:f0", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1f24c3-d7", "ovs_interfaceid": "4d1f24c3-d7a8-450a-92d5-0e807355b791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:42:42.043825 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converting VIF {"id": "4d1f24c3-d7a8-450a-92d5-0e807355b791", "address": "fa:16:3e:07:d0:f0", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1f24c3-d7", "ovs_interfaceid": "4d1f24c3-d7a8-450a-92d5-0e807355b791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:42:42.044319 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:d0:f0,bridge_name='br-int',has_traffic_filtering=True,id=4d1f24c3-d7a8-450a-92d5-0e807355b791,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d1f24c3-d7') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:42:42.044961 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1434404356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-1434404356',id=8,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5fI7yNY+vtWfP6sAEqW81Ob/M0+caqTNEaqf66GbJOFzQ10yeZKXCZkAEA1454wRog9bgRijpgzGKf9EXrMHobXUkpq6fgIwY7w+jABzxBMefwpq8P4Wvi0vvmcHxoKQ==',key_name='tempest-keypair-1601168903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c1a4dead6ad4de1bb75262d9c52bbee',ramdisk_id='',reservation_id='r-gtp0jtk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-479660225',owner_user_name='tempest-TaggedBootDevicesTest_v242-479660225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be344ec982ae4676b6a89325d3578d73',uuid=9c033870-f167-4235-86ff-98005452a16c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "789bf2ca-f86e-403a-88a3-0103291a84df", "address": "fa:16:3e:e6:93:6b", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap789bf2ca-f8", "ovs_interfaceid": "789bf2ca-f86e-403a-88a3-0103291a84df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:42:42.045121 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converting VIF {"id": "789bf2ca-f86e-403a-88a3-0103291a84df", "address": "fa:16:3e:e6:93:6b", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap789bf2ca-f8", "ovs_interfaceid": "789bf2ca-f86e-403a-88a3-0103291a84df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:42:42.045636 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:93:6b,bridge_name='br-int',has_traffic_filtering=True,id=789bf2ca-f86e-403a-88a3-0103291a84df,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap789bf2ca-f8') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:42:42.046453 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1434404356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-1434404356',id=8,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5fI7yNY+vtWfP6sAEqW81Ob/M0+caqTNEaqf66GbJOFzQ10yeZKXCZkAEA1454wRog9bgRijpgzGKf9EXrMHobXUkpq6fgIwY7w+jABzxBMefwpq8P4Wvi0vvmcHxoKQ==',key_name='tempest-keypair-1601168903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c1a4dead6ad4de1bb75262d9c52bbee',ramdisk_id='',reservation_id='r-gtp0jtk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-479660225',owner_user_name='tempest-TaggedBootDevicesTest_v242-479660225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be344ec982ae4676b6a89325d3578d73',uuid=9c033870-f167-4235-86ff-98005452a16c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa227a29-8d0b-49f2-a71e-233ba6d38b79", "address": "fa:16:3e:d3:38:9d", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa227a29-8d", "ovs_interfaceid": "aa227a29-8d0b-49f2-a71e-233ba6d38b79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:42:42.046786 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converting VIF {"id": "aa227a29-8d0b-49f2-a71e-233ba6d38b79", "address": "fa:16:3e:d3:38:9d", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa227a29-8d", "ovs_interfaceid": "aa227a29-8d0b-49f2-a71e-233ba6d38b79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:42:42.047293 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:38:9d,bridge_name='br-int',has_traffic_filtering=True,id=aa227a29-8d0b-49f2-a71e-233ba6d38b79,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa227a29-8d') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:42:42.047969 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1434404356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-1434404356',id=8,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5fI7yNY+vtWfP6sAEqW81Ob/M0+caqTNEaqf66GbJOFzQ10yeZKXCZkAEA1454wRog9bgRijpgzGKf9EXrMHobXUkpq6fgIwY7w+jABzxBMefwpq8P4Wvi0vvmcHxoKQ==',key_name='tempest-keypair-1601168903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c1a4dead6ad4de1bb75262d9c52bbee',ramdisk_id='',reservation_id='r-gtp0jtk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-479660225',owner_user_name='tempest-TaggedBootDevicesTest_v242-479660225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be344ec982ae4676b6a89325d3578d73',uuid=9c033870-f167-4235-86ff-98005452a16c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40295919-4c2c-4e1e-be95-73e18d612ce4", "address": "fa:16:3e:06:1d:a0", "network": {"id": "9feb5d39-ce22-4ffd-b5a0-f44a21399308", "bridge": "br-int", "label": "tempest-device-tagging-net2-639540845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40295919-4c", "ovs_interfaceid": "40295919-4c2c-4e1e-be95-73e18d612ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:42:42.048117 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converting VIF {"id": "40295919-4c2c-4e1e-be95-73e18d612ce4", "address": "fa:16:3e:06:1d:a0", "network": {"id": "9feb5d39-ce22-4ffd-b5a0-f44a21399308", "bridge": "br-int", "label": "tempest-device-tagging-net2-639540845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40295919-4c", "ovs_interfaceid": "40295919-4c2c-4e1e-be95-73e18d612ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:42:42.048472 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:1d:a0,bridge_name='br-int',has_traffic_filtering=True,id=40295919-4c2c-4e1e-be95-73e18d612ce4,network=Network(9feb5d39-ce22-4ffd-b5a0-f44a21399308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40295919-4c') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:42:42.049119 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1434404356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-1434404356',id=8,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5fI7yNY+vtWfP6sAEqW81Ob/M0+caqTNEaqf66GbJOFzQ10yeZKXCZkAEA1454wRog9bgRijpgzGKf9EXrMHobXUkpq6fgIwY7w+jABzxBMefwpq8P4Wvi0vvmcHxoKQ==',key_name='tempest-keypair-1601168903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c1a4dead6ad4de1bb75262d9c52bbee',ramdisk_id='',reservation_id='r-gtp0jtk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-479660225',owner_user_name='tempest-TaggedBootDevicesTest_v242-479660225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be344ec982ae4676b6a89325d3578d73',uuid=9c033870-f167-4235-86ff-98005452a16c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f002d56c-77f0-4fb0-9501-751106b08f89", "address": "fa:16:3e:fe:a0:95", "network": {"id": "9feb5d39-ce22-4ffd-b5a0-f44a21399308", "bridge": "br-int", "label": "tempest-device-tagging-net2-639540845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf002d56c-77", "ovs_interfaceid": "f002d56c-77f0-4fb0-9501-751106b08f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:42:42.049305 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converting VIF {"id": "f002d56c-77f0-4fb0-9501-751106b08f89", "address": "fa:16:3e:fe:a0:95", "network": {"id": "9feb5d39-ce22-4ffd-b5a0-f44a21399308", "bridge": "br-int", "label": "tempest-device-tagging-net2-639540845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf002d56c-77", "ovs_interfaceid": "f002d56c-77f0-4fb0-9501-751106b08f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:42:42.049660 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a0:95,bridge_name='br-int',has_traffic_filtering=True,id=f002d56c-77f0-4fb0-9501-751106b08f89,network=Network(9feb5d39-ce22-4ffd-b5a0-f44a21399308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf002d56c-77') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:42:42.050841 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c033870-f167-4235-86ff-98005452a16c {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:42.314225 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Calling os-brick to attach iSCSI Volume {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 25 04:42:42.314564 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:42:42.314740 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:42.315185 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:42.315411 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 25 04:42:42.318831 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:42:42.326775 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:42.327387 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:42.327918 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:42.328141 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:42:42.328532 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:42.328789 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:42:42.337081 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "refresh_cache-1b412363-2fb7-4469-b748-80cc52825bb5" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.startup = automatic Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.scan = manual Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.40.100 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:42:42.342318 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.startup = automatic Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.scan = manual Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.50.100 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:42:42.347604 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:42.356408 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:42.362181 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:42.380347 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:42.380347 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:42.380347 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:42.380347 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:42.380347 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:42.380347 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:42.380347 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:42:42.380347 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:42:42.380347 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:42.380347 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:42.380347 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:42.380347 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:42.380347 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:42.380938 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:42.380938 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:42.380938 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:42.380938 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:42.380938 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:42.380938 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:42.380938 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:42:42.380938 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:42:42.380938 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:42.380938 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:42.380938 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:42.380938 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:42.380938 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:42.381194 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:42.381194 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:42.381194 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:42.381194 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:42.381194 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:42.381194 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:42.381194 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:42:42.381194 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:42:42.381194 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:42.381194 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:42.381194 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:42.381194 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:42.381194 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:42.381774 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:42.381774 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:42.381774 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:42.381774 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:42.381774 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:42.381774 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:42.381774 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:42:42.381774 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:42:42.381774 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:42.381774 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:42.381774 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:42.381774 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:42.381774 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:42.382067 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.053s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:42.382140 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to 192.168.50.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:42:42.382426 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.054s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:42.382630 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to 192.168.40.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:42:42.383920 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] HCTL ('17', '0', '0', 0) found on session 13 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:42:42.384070 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Scanning host 17 c: 0, t: 0, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:42:42.384612 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] HCTL ('18', '0', '0', 0) found on session 14 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:42:42.384747 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Scanning host 18 c: 0, t: 0, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:42:42.392465 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching for a device in session 13 and hctl ('17', '0', '0', 0) yield: sdl {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:42:42.392668 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:42:42.393635 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching for a device in session 14 and hctl ('18', '0', '0', 0) yield: sdm {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:42:42.393770 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:42:42.412110 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-3c262e19-7950-4c18-9f33-f8af87915688 req-0a909de7-4756-4a48-8827-ff51952afa07 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:42.496282 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-3c262e19-7950-4c18-9f33-f8af87915688 req-0a909de7-4756-4a48-8827-ff51952afa07 service nova] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:42:42.528124 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-ba25a7e8-a1f6-417f-a4dc-3805ad5eaecc tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Start destroying the instance on the hypervisor. {{(pid=98952) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 25 04:42:42.547448 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.557713 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] End _get_guest_xml xml= Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: 9c033870-f167-4235-86ff-98005452a16c Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: instance-00000008 Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: 196608 Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: tempest-device-tagging-server-1434404356 Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: 2026-06-25 04:42:28 Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: 192 Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: 0 Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: 0 Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: True Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: bare Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: 0 Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: virtio Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: tempest-TaggedBootDevicesTest_v242-479660225-project-member Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: tempest-TaggedBootDevicesTest_v242-479660225 Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: 9c033870-f167-4235-86ff-98005452a16c Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: 9c033870-f167-4235-86ff-98005452a16c Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: hvm Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: 128 Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: 1a3ea2da-7efc-4b95-830c-6c043906aa00 Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: e0002b7f-67b9-4af1-82f9-7e5e8a55faaf Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: cc7be47d-8d0a-4286-86d2-621b59df6075 Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: Jun 25 04:42:42.564111 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:42:42.570024 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Preparing to wait for external event network-vif-plugged-e12da27e-2953-4784-80b6-5f7204f4e399 {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:42:42.570024 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:42.570631 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:42.572107 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:42.572107 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Preparing to wait for external event network-vif-plugged-7e8846aa-559c-48a1-bf9a-ab431fd380ed {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:42:42.572107 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:42.572107 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:42.572107 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:42.572107 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Preparing to wait for external event network-vif-plugged-4d1f24c3-d7a8-450a-92d5-0e807355b791 {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:42:42.572107 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:42.572107 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:42.573852 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:42.573852 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Preparing to wait for external event network-vif-plugged-789bf2ca-f86e-403a-88a3-0103291a84df {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:42:42.573852 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:42.573852 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:42.573852 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:42.573852 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Preparing to wait for external event network-vif-plugged-aa227a29-8d0b-49f2-a71e-233ba6d38b79 {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:42:42.573852 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:42.573852 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:42.574699 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:42.574699 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Preparing to wait for external event network-vif-plugged-40295919-4c2c-4e1e-be95-73e18d612ce4 {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:42:42.574699 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:42.574699 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:42.574699 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:42.574699 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Preparing to wait for external event network-vif-plugged-f002d56c-77f0-4fb0-9501-751106b08f89 {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:42:42.575994 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:42.575994 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:42.575994 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:42.575994 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1434404356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-1434404356',id=8,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5fI7yNY+vtWfP6sAEqW81Ob/M0+caqTNEaqf66GbJOFzQ10yeZKXCZkAEA1454wRog9bgRijpgzGKf9EXrMHobXUkpq6fgIwY7w+jABzxBMefwpq8P4Wvi0vvmcHxoKQ==',key_name='tempest-keypair-1601168903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c1a4dead6ad4de1bb75262d9c52bbee',ramdisk_id='',reservation_id='r-gtp0jtk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-479660225',owner_user_name='tempest-TaggedBootDevicesTest_v242-479660225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be344ec982ae4676b6a89325d3578d73',uuid=9c033870-f167-4235-86ff-98005452a16c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e12da27e-2953-4784-80b6-5f7204f4e399", "address": "fa:16:3e:ab:c3:d8", "network": {"id": "179999b1-f8ab-4073-96b7-da830d110303", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1298382094-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape12da27e-29", "ovs_interfaceid": "e12da27e-2953-4784-80b6-5f7204f4e399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:42:42.575994 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converting VIF {"id": "e12da27e-2953-4784-80b6-5f7204f4e399", "address": "fa:16:3e:ab:c3:d8", "network": {"id": "179999b1-f8ab-4073-96b7-da830d110303", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1298382094-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape12da27e-29", "ovs_interfaceid": "e12da27e-2953-4784-80b6-5f7204f4e399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:42:42.576828 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c3:d8,bridge_name='br-int',has_traffic_filtering=True,id=e12da27e-2953-4784-80b6-5f7204f4e399,network=Network(179999b1-f8ab-4073-96b7-da830d110303),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape12da27e-29') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:42:42.576828 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c3:d8,bridge_name='br-int',has_traffic_filtering=True,id=e12da27e-2953-4784-80b6-5f7204f4e399,network=Network(179999b1-f8ab-4073-96b7-da830d110303),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape12da27e-29') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:42:42.580431 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.580431 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.580431 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:42:42.580431 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.583302 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.583302 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1845d0f0-daea-565e-95aa-a0d89355aa96', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.587326 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.587326 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:42.611386 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Start spawning the instance on the hypervisor. {{(pid=98952) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 25 04:42:42.612514 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Creating instance directory {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 25 04:42:42.612715 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Creating image(s) Jun 25 04:42:42.613199 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "/opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:42.614273 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "/opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:42.615387 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "/opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:42.616221 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:42:42.620791 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.624433 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:42:42.626645 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:42.628666 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.628666 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape12da27e-29, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.628666 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape12da27e-29, col_values=(('qos', UUID('583af2f7-fb10-4708-b957-1ebc85ee0f78')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.628666 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape12da27e-29, col_values=(('external_ids', {'iface-id': 'e12da27e-2953-4784-80b6-5f7204f4e399', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:c3:d8', 'vm-uuid': '9c033870-f167-4235-86ff-98005452a16c'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.649593 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:42.652877 np0000003587 nova-compute[98952]: INFO os_vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c3:d8,bridge_name='br-int',has_traffic_filtering=True,id=e12da27e-2953-4784-80b6-5f7204f4e399,network=Network(179999b1-f8ab-4073-96b7-da830d110303),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape12da27e-29') Jun 25 04:42:42.654373 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1434404356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-1434404356',id=8,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5fI7yNY+vtWfP6sAEqW81Ob/M0+caqTNEaqf66GbJOFzQ10yeZKXCZkAEA1454wRog9bgRijpgzGKf9EXrMHobXUkpq6fgIwY7w+jABzxBMefwpq8P4Wvi0vvmcHxoKQ==',key_name='tempest-keypair-1601168903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c1a4dead6ad4de1bb75262d9c52bbee',ramdisk_id='',reservation_id='r-gtp0jtk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-479660225',owner_user_name='tempest-TaggedBootDevicesTest_v242-479660225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be344ec982ae4676b6a89325d3578d73',uuid=9c033870-f167-4235-86ff-98005452a16c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e8846aa-559c-48a1-bf9a-ab431fd380ed", "address": "fa:16:3e:6d:cc:4e", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8846aa-55", "ovs_interfaceid": "7e8846aa-559c-48a1-bf9a-ab431fd380ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:42:42.656081 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converting VIF {"id": "7e8846aa-559c-48a1-bf9a-ab431fd380ed", "address": "fa:16:3e:6d:cc:4e", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8846aa-55", "ovs_interfaceid": "7e8846aa-559c-48a1-bf9a-ab431fd380ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:42:42.657644 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:cc:4e,bridge_name='br-int',has_traffic_filtering=True,id=7e8846aa-559c-48a1-bf9a-ab431fd380ed,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e8846aa-55') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:42:42.658002 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:cc:4e,bridge_name='br-int',has_traffic_filtering=True,id=7e8846aa-559c-48a1-bf9a-ab431fd380ed,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e8846aa-55') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:42:42.659501 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.659501 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.659501 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:42:42.660878 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.661180 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88936cca-c325-5652-91bb-e9d77e4d20ab', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.662513 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.663842 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:42.676627 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.680157 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.680157 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e8846aa-55, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.680157 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e8846aa-55, col_values=(('qos', UUID('f14cb82f-920a-466f-8d82-cbbdd7e66f86')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.680157 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e8846aa-55, col_values=(('external_ids', {'iface-id': '7e8846aa-559c-48a1-bf9a-ab431fd380ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:cc:4e', 'vm-uuid': '9c033870-f167-4235-86ff-98005452a16c'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.682237 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.682237 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:42.700421 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.700945 np0000003587 nova-compute[98952]: INFO os_vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:cc:4e,bridge_name='br-int',has_traffic_filtering=True,id=7e8846aa-559c-48a1-bf9a-ab431fd380ed,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e8846aa-55') Jun 25 04:42:42.701875 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1434404356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-1434404356',id=8,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5fI7yNY+vtWfP6sAEqW81Ob/M0+caqTNEaqf66GbJOFzQ10yeZKXCZkAEA1454wRog9bgRijpgzGKf9EXrMHobXUkpq6fgIwY7w+jABzxBMefwpq8P4Wvi0vvmcHxoKQ==',key_name='tempest-keypair-1601168903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c1a4dead6ad4de1bb75262d9c52bbee',ramdisk_id='',reservation_id='r-gtp0jtk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-479660225',owner_user_name='tempest-TaggedBootDevicesTest_v242-479660225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be344ec982ae4676b6a89325d3578d73',uuid=9c033870-f167-4235-86ff-98005452a16c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d1f24c3-d7a8-450a-92d5-0e807355b791", "address": "fa:16:3e:07:d0:f0", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1f24c3-d7", "ovs_interfaceid": "4d1f24c3-d7a8-450a-92d5-0e807355b791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:42:42.702063 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converting VIF {"id": "4d1f24c3-d7a8-450a-92d5-0e807355b791", "address": "fa:16:3e:07:d0:f0", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1f24c3-d7", "ovs_interfaceid": "4d1f24c3-d7a8-450a-92d5-0e807355b791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:42:42.702673 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:d0:f0,bridge_name='br-int',has_traffic_filtering=True,id=4d1f24c3-d7a8-450a-92d5-0e807355b791,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d1f24c3-d7') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:42:42.702950 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:d0:f0,bridge_name='br-int',has_traffic_filtering=True,id=4d1f24c3-d7a8-450a-92d5-0e807355b791,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d1f24c3-d7') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:42:42.703745 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.703745 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.703745 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:42:42.705026 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.705026 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fcdcd86a-6cef-50e8-acec-b177408fef3d', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.706112 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.706112 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:42.717447 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.091s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:42.717936 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:42.718451 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:42.725594 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:42:42.725594 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.730565 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-3c262e19-7950-4c18-9f33-f8af87915688 req-0a909de7-4756-4a48-8827-ff51952afa07 service nova] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:42.734100 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:42:42.735759 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:42.752419 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.753515 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d1f24c3-d7, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.755951 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d1f24c3-d7, col_values=(('qos', UUID('fb1b6a5a-a3d5-4ce5-af0d-e05434e179b0')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.755951 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d1f24c3-d7, col_values=(('external_ids', {'iface-id': '4d1f24c3-d7a8-450a-92d5-0e807355b791', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:d0:f0', 'vm-uuid': '9c033870-f167-4235-86ff-98005452a16c'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.757793 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.759387 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:42.779541 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.781594 np0000003587 nova-compute[98952]: INFO os_vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:d0:f0,bridge_name='br-int',has_traffic_filtering=True,id=4d1f24c3-d7a8-450a-92d5-0e807355b791,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d1f24c3-d7') Jun 25 04:42:42.782127 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1434404356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-1434404356',id=8,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5fI7yNY+vtWfP6sAEqW81Ob/M0+caqTNEaqf66GbJOFzQ10yeZKXCZkAEA1454wRog9bgRijpgzGKf9EXrMHobXUkpq6fgIwY7w+jABzxBMefwpq8P4Wvi0vvmcHxoKQ==',key_name='tempest-keypair-1601168903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c1a4dead6ad4de1bb75262d9c52bbee',ramdisk_id='',reservation_id='r-gtp0jtk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-479660225',owner_user_name='tempest-TaggedBootDevicesTest_v242-479660225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be344ec982ae4676b6a89325d3578d73',uuid=9c033870-f167-4235-86ff-98005452a16c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "789bf2ca-f86e-403a-88a3-0103291a84df", "address": "fa:16:3e:e6:93:6b", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap789bf2ca-f8", "ovs_interfaceid": "789bf2ca-f86e-403a-88a3-0103291a84df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:42:42.782362 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converting VIF {"id": "789bf2ca-f86e-403a-88a3-0103291a84df", "address": "fa:16:3e:e6:93:6b", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap789bf2ca-f8", "ovs_interfaceid": "789bf2ca-f86e-403a-88a3-0103291a84df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:42:42.783055 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:93:6b,bridge_name='br-int',has_traffic_filtering=True,id=789bf2ca-f86e-403a-88a3-0103291a84df,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap789bf2ca-f8') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:42:42.783313 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:93:6b,bridge_name='br-int',has_traffic_filtering=True,id=789bf2ca-f86e-403a-88a3-0103291a84df,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap789bf2ca-f8') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:42:42.785583 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.785583 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.785583 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:42:42.785583 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.785804 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '929a50ef-d5e7-5e7f-909d-e222b435a89c', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.786466 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.787181 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:42.810724 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.814005 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.814291 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap789bf2ca-f8, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.814777 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap789bf2ca-f8, col_values=(('qos', UUID('2243be27-b43d-4b6b-a824-c05ac910668f')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.814987 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap789bf2ca-f8, col_values=(('external_ids', {'iface-id': '789bf2ca-f86e-403a-88a3-0103291a84df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:93:6b', 'vm-uuid': '9c033870-f167-4235-86ff-98005452a16c'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.816002 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.817801 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:42.820989 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.086s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:42.821366 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5/disk 1073741824 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:42.837611 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.748s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:42.838498 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:42:42.845786 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.181s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:42.851224 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.857404 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:42:42.857626 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Claim successful on node np0000003587 Jun 25 04:42:42.860890 np0000003587 nova-compute[98952]: INFO os_vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:93:6b,bridge_name='br-int',has_traffic_filtering=True,id=789bf2ca-f86e-403a-88a3-0103291a84df,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap789bf2ca-f8') Jun 25 04:42:42.861873 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1434404356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-1434404356',id=8,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5fI7yNY+vtWfP6sAEqW81Ob/M0+caqTNEaqf66GbJOFzQ10yeZKXCZkAEA1454wRog9bgRijpgzGKf9EXrMHobXUkpq6fgIwY7w+jABzxBMefwpq8P4Wvi0vvmcHxoKQ==',key_name='tempest-keypair-1601168903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c1a4dead6ad4de1bb75262d9c52bbee',ramdisk_id='',reservation_id='r-gtp0jtk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-479660225',owner_user_name='tempest-TaggedBootDevicesTest_v242-479660225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be344ec982ae4676b6a89325d3578d73',uuid=9c033870-f167-4235-86ff-98005452a16c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa227a29-8d0b-49f2-a71e-233ba6d38b79", "address": "fa:16:3e:d3:38:9d", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa227a29-8d", "ovs_interfaceid": "aa227a29-8d0b-49f2-a71e-233ba6d38b79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:42:42.862082 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converting VIF {"id": "aa227a29-8d0b-49f2-a71e-233ba6d38b79", "address": "fa:16:3e:d3:38:9d", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa227a29-8d", "ovs_interfaceid": "aa227a29-8d0b-49f2-a71e-233ba6d38b79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:42:42.862920 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:38:9d,bridge_name='br-int',has_traffic_filtering=True,id=aa227a29-8d0b-49f2-a71e-233ba6d38b79,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa227a29-8d') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:42:42.868590 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:38:9d,bridge_name='br-int',has_traffic_filtering=True,id=aa227a29-8d0b-49f2-a71e-233ba6d38b79,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa227a29-8d') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:42:42.868590 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.868590 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.868590 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:42:42.868590 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.868590 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c2edb842-4cde-541f-9613-83d1de46220e', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.875302 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.876181 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:42.877005 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5/disk 1073741824" returned: 0 in 0.055s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:42.877474 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.159s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:42.878001 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:42.902924 np0000003587 nova-compute[98952]: DEBUG nova.utils [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Queued Task(fn=>, remaining_delay=14.999211216000049 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:42:42.908279 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Instance destroyed successfully. Jun 25 04:42:42.909716 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-ba25a7e8-a1f6-417f-a4dc-3805ad5eaecc tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Lazy-loading 'resources' on Instance uuid 54721bc9-c45c-4cb1-9910-f47334e84cd2 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:42.925883 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.930073 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.930389 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa227a29-8d, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.931159 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa227a29-8d, col_values=(('qos', UUID('4246a76c-b97c-49b8-b28d-7a8e30c70ac9')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.931547 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa227a29-8d, col_values=(('external_ids', {'iface-id': 'aa227a29-8d0b-49f2-a71e-233ba6d38b79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:38:9d', 'vm-uuid': '9c033870-f167-4235-86ff-98005452a16c'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.933109 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.934685 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:42.949259 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.071s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:42.949710 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5/disk. size=1073741824 {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 25 04:42:42.950009 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:42.981115 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.983696 np0000003587 nova-compute[98952]: INFO os_vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:38:9d,bridge_name='br-int',has_traffic_filtering=True,id=aa227a29-8d0b-49f2-a71e-233ba6d38b79,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa227a29-8d') Jun 25 04:42:42.985977 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1434404356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-1434404356',id=8,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5fI7yNY+vtWfP6sAEqW81Ob/M0+caqTNEaqf66GbJOFzQ10yeZKXCZkAEA1454wRog9bgRijpgzGKf9EXrMHobXUkpq6fgIwY7w+jABzxBMefwpq8P4Wvi0vvmcHxoKQ==',key_name='tempest-keypair-1601168903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c1a4dead6ad4de1bb75262d9c52bbee',ramdisk_id='',reservation_id='r-gtp0jtk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-479660225',owner_user_name='tempest-TaggedBootDevicesTest_v242-479660225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be344ec982ae4676b6a89325d3578d73',uuid=9c033870-f167-4235-86ff-98005452a16c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40295919-4c2c-4e1e-be95-73e18d612ce4", "address": "fa:16:3e:06:1d:a0", "network": {"id": "9feb5d39-ce22-4ffd-b5a0-f44a21399308", "bridge": "br-int", "label": "tempest-device-tagging-net2-639540845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40295919-4c", "ovs_interfaceid": "40295919-4c2c-4e1e-be95-73e18d612ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:42:42.985977 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converting VIF {"id": "40295919-4c2c-4e1e-be95-73e18d612ce4", "address": "fa:16:3e:06:1d:a0", "network": {"id": "9feb5d39-ce22-4ffd-b5a0-f44a21399308", "bridge": "br-int", "label": "tempest-device-tagging-net2-639540845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40295919-4c", "ovs_interfaceid": "40295919-4c2c-4e1e-be95-73e18d612ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:42:42.985977 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:1d:a0,bridge_name='br-int',has_traffic_filtering=True,id=40295919-4c2c-4e1e-be95-73e18d612ce4,network=Network(9feb5d39-ce22-4ffd-b5a0-f44a21399308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40295919-4c') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:42:42.986342 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:1d:a0,bridge_name='br-int',has_traffic_filtering=True,id=40295919-4c2c-4e1e-be95-73e18d612ce4,network=Network(9feb5d39-ce22-4ffd-b5a0-f44a21399308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40295919-4c') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:42:42.986409 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.986818 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.986878 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:42:42.987847 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.988118 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb9eb90e-9aa1-544c-89ef-e37bbe164c4d', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:42.989611 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:42.991094 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:43.020169 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:43.022266 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:43.022409 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40295919-4c, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:43.022763 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap40295919-4c, col_values=(('qos', UUID('3623fc52-2e1a-4951-b6aa-64c8caede733')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:43.022921 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap40295919-4c, col_values=(('external_ids', {'iface-id': '40295919-4c2c-4e1e-be95-73e18d612ce4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:1d:a0', 'vm-uuid': '9c033870-f167-4235-86ff-98005452a16c'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:43.024020 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:43.025102 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:43.028251 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:43.028768 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Cannot resize image /opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5/disk to a smaller size. {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 25 04:42:43.029117 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Created local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 25 04:42:43.029945 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Ensure instance console log exists: /opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:42:43.029945 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:43.030499 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:43.031025 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:43.064424 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:43.064424 np0000003587 nova-compute[98952]: INFO os_vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:1d:a0,bridge_name='br-int',has_traffic_filtering=True,id=40295919-4c2c-4e1e-be95-73e18d612ce4,network=Network(9feb5d39-ce22-4ffd-b5a0-f44a21399308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40295919-4c') Jun 25 04:42:43.064424 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1434404356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-1434404356',id=8,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5fI7yNY+vtWfP6sAEqW81Ob/M0+caqTNEaqf66GbJOFzQ10yeZKXCZkAEA1454wRog9bgRijpgzGKf9EXrMHobXUkpq6fgIwY7w+jABzxBMefwpq8P4Wvi0vvmcHxoKQ==',key_name='tempest-keypair-1601168903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c1a4dead6ad4de1bb75262d9c52bbee',ramdisk_id='',reservation_id='r-gtp0jtk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-479660225',owner_user_name='tempest-TaggedBootDevicesTest_v242-479660225-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be344ec982ae4676b6a89325d3578d73',uuid=9c033870-f167-4235-86ff-98005452a16c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f002d56c-77f0-4fb0-9501-751106b08f89", "address": "fa:16:3e:fe:a0:95", "network": {"id": "9feb5d39-ce22-4ffd-b5a0-f44a21399308", "bridge": "br-int", "label": "tempest-device-tagging-net2-639540845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf002d56c-77", "ovs_interfaceid": "f002d56c-77f0-4fb0-9501-751106b08f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:42:43.064424 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converting VIF {"id": "f002d56c-77f0-4fb0-9501-751106b08f89", "address": "fa:16:3e:fe:a0:95", "network": {"id": "9feb5d39-ce22-4ffd-b5a0-f44a21399308", "bridge": "br-int", "label": "tempest-device-tagging-net2-639540845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf002d56c-77", "ovs_interfaceid": "f002d56c-77f0-4fb0-9501-751106b08f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:42:43.064424 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a0:95,bridge_name='br-int',has_traffic_filtering=True,id=f002d56c-77f0-4fb0-9501-751106b08f89,network=Network(9feb5d39-ce22-4ffd-b5a0-f44a21399308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf002d56c-77') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:42:43.064424 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a0:95,bridge_name='br-int',has_traffic_filtering=True,id=f002d56c-77f0-4fb0-9501-751106b08f89,network=Network(9feb5d39-ce22-4ffd-b5a0-f44a21399308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf002d56c-77') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:42:43.065212 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:43.065509 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:43.065791 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:42:43.067481 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:43.067481 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec249635-381f-5273-a5e8-d25bd57bffd5', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:43.068340 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:43.068340 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:43.103217 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:43.106347 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:43.106347 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf002d56c-77, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:43.106347 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf002d56c-77, col_values=(('qos', UUID('2b1aef18-a8b6-4247-8e69-5d544cdb40ed')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:43.106347 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf002d56c-77, col_values=(('external_ids', {'iface-id': 'f002d56c-77f0-4fb0-9501-751106b08f89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:a0:95', 'vm-uuid': '9c033870-f167-4235-86ff-98005452a16c'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:43.107746 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:43.144797 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:43.146970 np0000003587 nova-compute[98952]: INFO os_vif [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a0:95,bridge_name='br-int',has_traffic_filtering=True,id=f002d56c-77f0-4fb0-9501-751106b08f89,network=Network(9feb5d39-ce22-4ffd-b5a0-f44a21399308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf002d56c-77') Jun 25 04:42:43.236539 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-3c262e19-7950-4c18-9f33-f8af87915688 req-0a909de7-4756-4a48-8827-ff51952afa07 service nova] Releasing lock "refresh_cache-1b412363-2fb7-4469-b748-80cc52825bb5" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:42:43.237167 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquired lock "refresh_cache-1b412363-2fb7-4469-b748-80cc52825bb5" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:42:43.237373 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:42:43.328962 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 25 04:42:43.353824 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:42:43.355625 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:42:43.356132 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:43.356547 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:43.414943 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-ba25a7e8-a1f6-417f-a4dc-3805ad5eaecc tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1227199569',display_name='tempest-VolumesAssistedSnapshotsTest-server-1227199569',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-volumesassistedsnapshotstest-server-1227199569',id=5,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbIZAFVua5mBPvMJOilRXmBvLsyInZ+SWc61AFvIErIYKRe5Z87o2zKqzduRk6h553mssYTF0MlLORTw6cOhK1B33hhsDc52xx3z+75MCTk5ugCM+y+8KBeiBg0Zgm4+A==',key_name='tempest-keypair-360538157',keypairs=,launch_index=0,launched_at=2026-06-25T04:41:41Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='6eb74c8d593e41439c11018567cee50e',ramdisk_id='',reservation_id='r-gr10d9pc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-382681988',owner_user_name='tempest-VolumesAssistedSnapshotsTest-382681988-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:41:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='179040074a1049d9bc174be848d7d9c0',uuid=54721bc9-c45c-4cb1-9910-f47334e84cd2,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0", "address": "fa:16:3e:b0:e8:8f", "network": {"id": "fdf32429-f589-4e76-997e-ddfdb055d2fc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-863894942-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6eb74c8d593e41439c11018567cee50e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6c191b-4d", "ovs_interfaceid": "0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:42:43.415289 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-ba25a7e8-a1f6-417f-a4dc-3805ad5eaecc tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Converting VIF {"id": "0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0", "address": "fa:16:3e:b0:e8:8f", "network": {"id": "fdf32429-f589-4e76-997e-ddfdb055d2fc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-863894942-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6eb74c8d593e41439c11018567cee50e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6c191b-4d", "ovs_interfaceid": "0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:42:43.415675 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-ba25a7e8-a1f6-417f-a4dc-3805ad5eaecc tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:e8:8f,bridge_name='br-int',has_traffic_filtering=True,id=0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0,network=Network(fdf32429-f589-4e76-997e-ddfdb055d2fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6c191b-4d') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:42:43.416174 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-ba25a7e8-a1f6-417f-a4dc-3805ad5eaecc tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:e8:8f,bridge_name='br-int',has_traffic_filtering=True,id=0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0,network=Network(fdf32429-f589-4e76-997e-ddfdb055d2fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6c191b-4d') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:42:43.417175 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:43.417483 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a6c191b-4d, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:43.419026 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:43.420023 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:43.455108 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f9bd46f11cd4d38bbf9926be137ca8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdd814e374462e9477baf02d6c2fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:42:43.459536 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:43.460977 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:43.461167 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42f4ec77-a437-4cfd-b984-265a425e9499) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:43.462122 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:43.462924 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:43.500170 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:43.503109 np0000003587 nova-compute[98952]: INFO os_vif [None req-ba25a7e8-a1f6-417f-a4dc-3805ad5eaecc tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:e8:8f,bridge_name='br-int',has_traffic_filtering=True,id=0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0,network=Network(fdf32429-f589-4e76-997e-ddfdb055d2fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6c191b-4d') Jun 25 04:42:43.503617 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-ba25a7e8-a1f6-417f-a4dc-3805ad5eaecc tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Deleting instance files /opt/stack/data/nova/instances/54721bc9-c45c-4cb1-9910-f47334e84cd2_del Jun 25 04:42:43.504704 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-ba25a7e8-a1f6-417f-a4dc-3805ad5eaecc tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Deletion of /opt/stack/data/nova/instances/54721bc9-c45c-4cb1-9910-f47334e84cd2_del complete Jun 25 04:42:43.816020 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:42:43.859483 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 25 04:42:43.985914 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-7e26534e-c8a2-4b8e-8b10-56bf95cb1ac4 req-b1bfe665-c6fe-406f-a9df-004c599e6737 service nova] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Received event network-vif-unplugged-0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:43.986098 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-7e26534e-c8a2-4b8e-8b10-56bf95cb1ac4 req-b1bfe665-c6fe-406f-a9df-004c599e6737 service nova] Acquiring lock "54721bc9-c45c-4cb1-9910-f47334e84cd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:43.987142 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-7e26534e-c8a2-4b8e-8b10-56bf95cb1ac4 req-b1bfe665-c6fe-406f-a9df-004c599e6737 service nova] Lock "54721bc9-c45c-4cb1-9910-f47334e84cd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:43.988134 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-7e26534e-c8a2-4b8e-8b10-56bf95cb1ac4 req-b1bfe665-c6fe-406f-a9df-004c599e6737 service nova] Lock "54721bc9-c45c-4cb1-9910-f47334e84cd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:43.988340 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-7e26534e-c8a2-4b8e-8b10-56bf95cb1ac4 req-b1bfe665-c6fe-406f-a9df-004c599e6737 service nova] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] No waiting events found dispatching network-vif-unplugged-0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:42:43.988455 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-7e26534e-c8a2-4b8e-8b10-56bf95cb1ac4 req-b1bfe665-c6fe-406f-a9df-004c599e6737 service nova] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Received event network-vif-unplugged-0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:42:43.988682 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-7e26534e-c8a2-4b8e-8b10-56bf95cb1ac4 req-b1bfe665-c6fe-406f-a9df-004c599e6737 service nova] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Received event network-vif-unplugged-0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:43.988869 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-7e26534e-c8a2-4b8e-8b10-56bf95cb1ac4 req-b1bfe665-c6fe-406f-a9df-004c599e6737 service nova] Acquiring lock "54721bc9-c45c-4cb1-9910-f47334e84cd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:43.989043 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-7e26534e-c8a2-4b8e-8b10-56bf95cb1ac4 req-b1bfe665-c6fe-406f-a9df-004c599e6737 service nova] Lock "54721bc9-c45c-4cb1-9910-f47334e84cd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:43.989247 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-7e26534e-c8a2-4b8e-8b10-56bf95cb1ac4 req-b1bfe665-c6fe-406f-a9df-004c599e6737 service nova] Lock "54721bc9-c45c-4cb1-9910-f47334e84cd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:43.989364 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-7e26534e-c8a2-4b8e-8b10-56bf95cb1ac4 req-b1bfe665-c6fe-406f-a9df-004c599e6737 service nova] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] No waiting events found dispatching network-vif-unplugged-0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:42:43.989760 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-7e26534e-c8a2-4b8e-8b10-56bf95cb1ac4 req-b1bfe665-c6fe-406f-a9df-004c599e6737 service nova] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Received event network-vif-unplugged-0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:42:44.011260 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-ba25a7e8-a1f6-417f-a4dc-3805ad5eaecc tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Took 1.48 seconds to destroy the instance on the hypervisor. Jun 25 04:42:44.012637 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._common.loopingcall [None req-ba25a7e8-a1f6-417f-a4dc-3805ad5eaecc tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98952) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 25 04:42:44.013065 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [-] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Deallocating network for instance {{(pid=98952) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 25 04:42:44.013065 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] deallocate_for_instance() {{(pid=98952) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 25 04:42:44.013223 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:44.041250 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Successfully created port: 93cdbb39-15d6-4bb1-a55a-bccc139ac288 {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:42:44.045976 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:44.157008 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:44.246416 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Updating instance_info_cache with network_info: [{"id": "53b9a3dd-c125-4e7b-b3ee-9debd47394dd", "address": "fa:16:3e:ee:97:a2", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b9a3dd-c1", "ovs_interfaceid": "53b9a3dd-c125-4e7b-b3ee-9debd47394dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:44.345972 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Found WWN 330000000f79aaea1 for multipath device dm-9 {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 25 04:42:44.346502 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.031s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:44.346857 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] <== connect_volume: return (2032ms) {'type': 'block', 'scsi_wwn': '330000000f79aaea1', 'path': '/dev/dm-9', 'multipath_id': '330000000f79aaea1'} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:42:44.347396 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f79aaea1', 'path': '/dev/dm-9', 'multipath_id': '330000000f79aaea1'} {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 25 04:42:44.350010 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lazy-loading 'flavor' on Instance uuid 19180a23-a7e0-4354-b9f4-9ca57062fc06 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:44.364460 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Start building block device mappings for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 25 04:42:44.611917 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:42:44.612153 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:42:44.669689 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:42:44.670998 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:42:44.671156 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] No VIF found with MAC fa:16:3e:ab:c3:d8, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:42:44.671492 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] No VIF found with MAC fa:16:3e:d3:38:9d, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:42:44.672209 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Using config drive Jun 25 04:42:44.747724 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Successfully updated port: 93cdbb39-15d6-4bb1-a55a-bccc139ac288 {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:42:44.752967 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Releasing lock "refresh_cache-1b412363-2fb7-4469-b748-80cc52825bb5" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:42:44.753264 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Instance network_info: |[{"id": "53b9a3dd-c125-4e7b-b3ee-9debd47394dd", "address": "fa:16:3e:ee:97:a2", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b9a3dd-c1", "ovs_interfaceid": "53b9a3dd-c125-4e7b-b3ee-9debd47394dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 25 04:42:44.755949 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Start _get_guest_xml network_info=[{"id": "53b9a3dd-c125-4e7b-b3ee-9debd47394dd", "address": "fa:16:3e:ee:97:a2", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b9a3dd-c1", "ovs_interfaceid": "53b9a3dd-c125-4e7b-b3ee-9debd47394dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '4ecaf199-c1b9-4ce3-869c-178c170c1662'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:42:44.759754 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:42:44.761881 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-234069485', uuid='1b412363-2fb7-4469-b748-80cc52825bb5'), owner=OwnerMeta(userid='27ebe4b23b624995a52b9313ff9e318a', username='tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member', projectid='a5d52ed3b8de460eb65a8fb4ad1b015d', projectname='tempest-ServerBootFromVolumeStableRescueTest-6878904'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "53b9a3dd-c125-4e7b-b3ee-9debd47394dd", "address": "fa:16:3e:ee:97:a2", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b9a3dd-c1", "ovs_interfaceid": "53b9a3dd-c125-4e7b-b3ee-9debd47394dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362564.7607558) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:42:44.763809 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:42:44.763809 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:42:44.765603 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:42:44.765603 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:42:44.767769 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:42:44.767769 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:42:44.767769 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:42:44.767769 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:42:44.767769 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:42:44.767769 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:42:44.767769 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:42:44.767769 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:42:44.767769 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:42:44.767769 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:42:44.767769 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:42:44.767769 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:42:44.784199 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:42:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-234069485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-serverbootfromvolumestablerescuetest-server-234069485',id=10,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5d52ed3b8de460eb65a8fb4ad1b015d',ramdisk_id='',reservation_id='r-qe17im33',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-6878904',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:42Z,user_data=None,user_id='27ebe4b23b624995a52b9313ff9e318a',uuid=1b412363-2fb7-4469-b748-80cc52825bb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53b9a3dd-c125-4e7b-b3ee-9debd47394dd", "address": "fa:16:3e:ee:97:a2", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b9a3dd-c1", "ovs_interfaceid": "53b9a3dd-c125-4e7b-b3ee-9debd47394dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:42:44.784396 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converting VIF {"id": "53b9a3dd-c125-4e7b-b3ee-9debd47394dd", "address": "fa:16:3e:ee:97:a2", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b9a3dd-c1", "ovs_interfaceid": "53b9a3dd-c125-4e7b-b3ee-9debd47394dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:42:44.786418 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:97:a2,bridge_name='br-int',has_traffic_filtering=True,id=53b9a3dd-c125-4e7b-b3ee-9debd47394dd,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53b9a3dd-c1') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:42:44.789216 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b412363-2fb7-4469-b748-80cc52825bb5 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:44.802139 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-05f26a0e-437f-48fe-a1bd-e630f201aa94 req-2fdef508-7b1f-4271-a1d2-24363c6a5b9d service nova] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Received event network-changed-93cdbb39-15d6-4bb1-a55a-bccc139ac288 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:44.802581 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-05f26a0e-437f-48fe-a1bd-e630f201aa94 req-2fdef508-7b1f-4271-a1d2-24363c6a5b9d service nova] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Refreshing instance network info cache due to event network-changed-93cdbb39-15d6-4bb1-a55a-bccc139ac288. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:42:44.802803 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-05f26a0e-437f-48fe-a1bd-e630f201aa94 req-2fdef508-7b1f-4271-a1d2-24363c6a5b9d service nova] Acquiring lock "refresh_cache-775ef107-e7ca-4d94-b5ab-2ec8665a4906" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:44.802970 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-05f26a0e-437f-48fe-a1bd-e630f201aa94 req-2fdef508-7b1f-4271-a1d2-24363c6a5b9d service nova] Acquired lock "refresh_cache-775ef107-e7ca-4d94-b5ab-2ec8665a4906" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:42:44.803117 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-05f26a0e-437f-48fe-a1bd-e630f201aa94 req-2fdef508-7b1f-4271-a1d2-24363c6a5b9d service nova] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Refreshing network info cache for port 93cdbb39-15d6-4bb1-a55a-bccc139ac288 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:42:44.852879 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Attempting to attach volume 9ed8d9ce-b06c-4856-91a6-090a64fd59c4 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98952) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 25 04:42:44.853902 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] attach device xml: Jun 25 04:42:44.853902 np0000003587 nova-compute[98952]: Jun 25 04:42:44.853902 np0000003587 nova-compute[98952]: Jun 25 04:42:44.853902 np0000003587 nova-compute[98952]: Jun 25 04:42:44.853902 np0000003587 nova-compute[98952]: Jun 25 04:42:44.853902 np0000003587 nova-compute[98952]: 9ed8d9ce-b06c-4856-91a6-090a64fd59c4 Jun 25 04:42:44.853902 np0000003587 nova-compute[98952]: Jun 25 04:42:44.853902 np0000003587 nova-compute[98952]: Jun 25 04:42:44.853902 np0000003587 nova-compute[98952]: {{(pid=98952) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 25 04:42:44.860401 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:45.115218 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:42:45.187823 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:45.250502 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Acquiring lock "refresh_cache-775ef107-e7ca-4d94-b5ab-2ec8665a4906" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] End _get_guest_xml xml= Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: 1b412363-2fb7-4469-b748-80cc52825bb5 Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: instance-0000000a Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: 196608 Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: tempest-ServerBootFromVolumeStableRescueTest-server-234069485 Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: 2026-06-25 04:42:44 Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: 192 Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: 0 Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: 0 Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: True Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: bare Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: 0 Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: virtio Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: tempest-ServerBootFromVolumeStableRescueTest-6878904 Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: 1b412363-2fb7-4469-b748-80cc52825bb5 Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: 1b412363-2fb7-4469-b748-80cc52825bb5 Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: hvm Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: 128 Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: Jun 25 04:42:45.292328 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:42:45.294500 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Preparing to wait for external event network-vif-plugged-53b9a3dd-c125-4e7b-b3ee-9debd47394dd {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:42:45.294500 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "1b412363-2fb7-4469-b748-80cc52825bb5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:45.294500 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "1b412363-2fb7-4469-b748-80cc52825bb5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:45.294500 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "1b412363-2fb7-4469-b748-80cc52825bb5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:45.294500 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:42:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-234069485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-serverbootfromvolumestablerescuetest-server-234069485',id=10,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5d52ed3b8de460eb65a8fb4ad1b015d',ramdisk_id='',reservation_id='r-qe17im33',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-6878904',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:42Z,user_data=None,user_id='27ebe4b23b624995a52b9313ff9e318a',uuid=1b412363-2fb7-4469-b748-80cc52825bb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53b9a3dd-c125-4e7b-b3ee-9debd47394dd", "address": "fa:16:3e:ee:97:a2", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b9a3dd-c1", "ovs_interfaceid": "53b9a3dd-c125-4e7b-b3ee-9debd47394dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:42:45.294500 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converting VIF {"id": "53b9a3dd-c125-4e7b-b3ee-9debd47394dd", "address": "fa:16:3e:ee:97:a2", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b9a3dd-c1", "ovs_interfaceid": "53b9a3dd-c125-4e7b-b3ee-9debd47394dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:42:45.294500 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:97:a2,bridge_name='br-int',has_traffic_filtering=True,id=53b9a3dd-c125-4e7b-b3ee-9debd47394dd,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53b9a3dd-c1') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:42:45.295824 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:97:a2,bridge_name='br-int',has_traffic_filtering=True,id=53b9a3dd-c125-4e7b-b3ee-9debd47394dd,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53b9a3dd-c1') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:42:45.295824 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:45.295824 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:45.295824 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:42:45.299985 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:45.300286 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f9646f7-00b4-51aa-ac3a-284a7b9eeccd', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:45.301915 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:45.312162 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-05f26a0e-437f-48fe-a1bd-e630f201aa94 req-2fdef508-7b1f-4271-a1d2-24363c6a5b9d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:45.346945 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:45.349718 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:45.349894 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53b9a3dd-c1, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:45.350262 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53b9a3dd-c1, col_values=(('qos', UUID('f219426f-593d-4ac8-87ea-e0efe257b348')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:45.350440 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53b9a3dd-c1, col_values=(('external_ids', {'iface-id': '53b9a3dd-c125-4e7b-b3ee-9debd47394dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:97:a2', 'vm-uuid': '1b412363-2fb7-4469-b748-80cc52825bb5'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:45.353105 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:45.374869 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-f9887eb2-5815-463c-b277-0c2a3ee43972 req-b3229968-5729-4afa-9552-9c7020ec146b service nova] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Received event network-vif-deleted-0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:45.374869 np0000003587 nova-compute[98952]: INFO nova.compute.manager [req-f9887eb2-5815-463c-b277-0c2a3ee43972 req-b3229968-5729-4afa-9552-9c7020ec146b service nova] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Neutron deleted interface 0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0; detaching it from the instance and deleting it from the info cache Jun 25 04:42:45.377311 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Start spawning the instance on the hypervisor. {{(pid=98952) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 25 04:42:45.382135 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-f9887eb2-5815-463c-b277-0c2a3ee43972 req-b3229968-5729-4afa-9552-9c7020ec146b service nova] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Detach interface failed, port_id=0a6c191b-4dce-4c69-aad3-9ab6e18bf4c0, reason: Instance 54721bc9-c45c-4cb1-9910-f47334e84cd2 could not be found. {{(pid=98952) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 25 04:42:45.383285 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Creating instance directory {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 25 04:42:45.383641 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Creating image(s) Jun 25 04:42:45.384548 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Acquiring lock "/opt/stack/data/nova/instances/775ef107-e7ca-4d94-b5ab-2ec8665a4906/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:45.384841 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "/opt/stack/data/nova/instances/775ef107-e7ca-4d94-b5ab-2ec8665a4906/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:45.386171 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "/opt/stack/data/nova/instances/775ef107-e7ca-4d94-b5ab-2ec8665a4906/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:45.386171 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:42:45.392206 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:42:45.393722 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:45.403698 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:45.410612 np0000003587 nova-compute[98952]: INFO os_vif [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:97:a2,bridge_name='br-int',has_traffic_filtering=True,id=53b9a3dd-c125-4e7b-b3ee-9debd47394dd,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53b9a3dd-c1') Jun 25 04:42:45.419600 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-05f26a0e-437f-48fe-a1bd-e630f201aa94 req-2fdef508-7b1f-4271-a1d2-24363c6a5b9d service nova] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:42:45.449291 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Creating config drive at /opt/stack/data/nova/instances/9c033870-f167-4235-86ff-98005452a16c/disk.config Jun 25 04:42:45.455111 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9c033870-f167-4235-86ff-98005452a16c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0y9keamr {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:45.484774 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.091s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:45.485479 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Acquiring lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:45.486150 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:45.486939 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:42:45.490843 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:42:45.491688 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:45.510707 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9c033870-f167-4235-86ff-98005452a16c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0y9keamr" returned: 0 in 0.055s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:45.577287 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.086s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:45.577699 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/775ef107-e7ca-4d94-b5ab-2ec8665a4906/disk 1073741824 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:45.626765 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.781s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:45.627439 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:42:45.631609 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 5.072s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:45.631873 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.004s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:45.632060 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Auditing locally available compute resources for np0000003587 (node: np0000003587) {{(pid=98952) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 25 04:42:45.633852 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/775ef107-e7ca-4d94-b5ab-2ec8665a4906/disk 1073741824" returned: 0 in 0.056s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:45.634034 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-15f152ae-8589-4dc4-afa9-b7132c575a18 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.669s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:45.634654 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.148s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:45.634758 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:45.659129 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-05f26a0e-437f-48fe-a1bd-e630f201aa94 req-2fdef508-7b1f-4271-a1d2-24363c6a5b9d service nova] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:45.716626 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.082s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:45.716958 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Checking if we can resize image /opt/stack/data/nova/instances/775ef107-e7ca-4d94-b5ab-2ec8665a4906/disk. size=1073741824 {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 25 04:42:45.717236 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775ef107-e7ca-4d94-b5ab-2ec8665a4906/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:45.801731 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:45.805379 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/775ef107-e7ca-4d94-b5ab-2ec8665a4906/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:45.806334 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Cannot resize image /opt/stack/data/nova/instances/775ef107-e7ca-4d94-b5ab-2ec8665a4906/disk to a smaller size. {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 25 04:42:45.806766 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Created local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 25 04:42:45.806960 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Ensure instance console log exists: /opt/stack/data/nova/instances/775ef107-e7ca-4d94-b5ab-2ec8665a4906/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:42:45.807279 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:45.807538 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:45.807724 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:46.000919 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:46.060873 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:46.123763 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:46.136278 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:42:46.136454 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:42:46.136871 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:46.137123 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:46.160319 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:46.165266 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-05f26a0e-437f-48fe-a1bd-e630f201aa94 req-2fdef508-7b1f-4271-a1d2-24363c6a5b9d service nova] Releasing lock "refresh_cache-775ef107-e7ca-4d94-b5ab-2ec8665a4906" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:42:46.167948 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Acquired lock "refresh_cache-775ef107-e7ca-4d94-b5ab-2ec8665a4906" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:42:46.168100 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:42:46.257697 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-ac977db3-5958-4964-92f0-5a2046bd95d5 req-69059d41-bc9a-4ae5-8b20-86997bd291b9 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-plugged-e12da27e-2953-4784-80b6-5f7204f4e399 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:46.259424 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ac977db3-5958-4964-92f0-5a2046bd95d5 req-69059d41-bc9a-4ae5-8b20-86997bd291b9 service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:46.259424 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ac977db3-5958-4964-92f0-5a2046bd95d5 req-69059d41-bc9a-4ae5-8b20-86997bd291b9 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:46.259739 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ac977db3-5958-4964-92f0-5a2046bd95d5 req-69059d41-bc9a-4ae5-8b20-86997bd291b9 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:46.259912 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-ac977db3-5958-4964-92f0-5a2046bd95d5 req-69059d41-bc9a-4ae5-8b20-86997bd291b9 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Processing event network-vif-plugged-e12da27e-2953-4784-80b6-5f7204f4e399 {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:42:46.264073 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:46.299140 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:46.306443 np0000003587 nova-compute[98952]: INFO nova.compute.manager [-] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Took 2.29 seconds to deallocate network for instance. Jun 25 04:42:46.339418 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:46.362361 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:46.379285 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:46.385702 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:46.411094 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-15f152ae-8589-4dc4-afa9-b7132c575a18 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:42:46.411427 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-15f152ae-8589-4dc4-afa9-b7132c575a18 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:42:46.443415 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:46.616152 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:46.631758 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e73054ab2cbd425cb182705f0ebfb7a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a42527a8b24135b741fe2c38dc14b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:42:46.636029 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:42:46.636165 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:42:46.636390 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:42:46.636390 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No VIF found with MAC fa:16:3e:4f:40:83, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:42:46.639206 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:46.642270 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 25 04:42:46.718288 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:46.724922 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:46.765425 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:46.779706 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d10650ad-9a63-42b7-9d98-10079afd00a7 req-e48c5b87-1fcd-4ad2-a386-c94f36ae65a9 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-plugged-aa227a29-8d0b-49f2-a71e-233ba6d38b79 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:46.779706 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d10650ad-9a63-42b7-9d98-10079afd00a7 req-e48c5b87-1fcd-4ad2-a386-c94f36ae65a9 service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:46.779940 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d10650ad-9a63-42b7-9d98-10079afd00a7 req-e48c5b87-1fcd-4ad2-a386-c94f36ae65a9 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:46.783653 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d10650ad-9a63-42b7-9d98-10079afd00a7 req-e48c5b87-1fcd-4ad2-a386-c94f36ae65a9 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:46.784281 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:46.784726 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d10650ad-9a63-42b7-9d98-10079afd00a7 req-e48c5b87-1fcd-4ad2-a386-c94f36ae65a9 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Processing event network-vif-plugged-aa227a29-8d0b-49f2-a71e-233ba6d38b79 {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:42:46.810379 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:46.820089 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:42:46.824813 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ba25a7e8-a1f6-417f-a4dc-3805ad5eaecc tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:46.896017 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:46.915064 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-15f152ae-8589-4dc4-afa9-b7132c575a18 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:42:46.939977 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:42:46.940142 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:42:46.940257 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] No VIF found with MAC fa:16:3e:ee:97:a2, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:42:46.941370 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Using config drive Jun 25 04:42:47.012981 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:47.020690 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:47.023393 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:47.045895 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:47.055891 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:47.180354 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0003246039998430206 future=) was cancelled during its delay period, skipping {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:42:47.180354 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:42:47.180354 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=6.529695733999915 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:42:47.180354 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=6.529624882000007 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:42:47.217964 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Updating instance_info_cache with network_info: [{"id": "93cdbb39-15d6-4bb1-a55a-bccc139ac288", "address": "fa:16:3e:07:f4:ac", "network": {"id": "d59f1de2-a0fd-4318-9724-66a1bbe8ec86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-557005970-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "00cdd814e374462e9477baf02d6c2fdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93cdbb39-15", "ovs_interfaceid": "93cdbb39-15d6-4bb1-a55a-bccc139ac288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:47.287009 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:47.293349 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-15f152ae-8589-4dc4-afa9-b7132c575a18 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.792s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ba25a7e8-a1f6-417f-a4dc-3805ad5eaecc tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.602s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6d1c0271-c6bf-4778-9ce0-8f09639c370f req-44f4b750-171b-4f46-bd5f-8d21448da788 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-plugged-7e8846aa-559c-48a1-bf9a-ab431fd380ed {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6d1c0271-c6bf-4778-9ce0-8f09639c370f req-44f4b750-171b-4f46-bd5f-8d21448da788 service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6d1c0271-c6bf-4778-9ce0-8f09639c370f req-44f4b750-171b-4f46-bd5f-8d21448da788 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6d1c0271-c6bf-4778-9ce0-8f09639c370f req-44f4b750-171b-4f46-bd5f-8d21448da788 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6d1c0271-c6bf-4778-9ce0-8f09639c370f req-44f4b750-171b-4f46-bd5f-8d21448da788 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Processing event network-vif-plugged-7e8846aa-559c-48a1-bf9a-ab431fd380ed {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6d1c0271-c6bf-4778-9ce0-8f09639c370f req-44f4b750-171b-4f46-bd5f-8d21448da788 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-plugged-7e8846aa-559c-48a1-bf9a-ab431fd380ed {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6d1c0271-c6bf-4778-9ce0-8f09639c370f req-44f4b750-171b-4f46-bd5f-8d21448da788 service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6d1c0271-c6bf-4778-9ce0-8f09639c370f req-44f4b750-171b-4f46-bd5f-8d21448da788 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6d1c0271-c6bf-4778-9ce0-8f09639c370f req-44f4b750-171b-4f46-bd5f-8d21448da788 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6d1c0271-c6bf-4778-9ce0-8f09639c370f req-44f4b750-171b-4f46-bd5f-8d21448da788 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] No event matching network-vif-plugged-7e8846aa-559c-48a1-bf9a-ab431fd380ed in dict_keys([('network-vif-plugged', '4d1f24c3-d7a8-450a-92d5-0e807355b791'), ('network-vif-plugged', '789bf2ca-f86e-403a-88a3-0103291a84df'), ('network-vif-plugged', '40295919-4c2c-4e1e-be95-73e18d612ce4'), ('network-vif-plugged', 'f002d56c-77f0-4fb0-9501-751106b08f89')]) {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-6d1c0271-c6bf-4778-9ce0-8f09639c370f req-44f4b750-171b-4f46-bd5f-8d21448da788 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received unexpected event network-vif-plugged-7e8846aa-559c-48a1-bf9a-ab431fd380ed for instance with vm_state building and task_state spawning. Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6d1c0271-c6bf-4778-9ce0-8f09639c370f req-44f4b750-171b-4f46-bd5f-8d21448da788 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-plugged-4d1f24c3-d7a8-450a-92d5-0e807355b791 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6d1c0271-c6bf-4778-9ce0-8f09639c370f req-44f4b750-171b-4f46-bd5f-8d21448da788 service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6d1c0271-c6bf-4778-9ce0-8f09639c370f req-44f4b750-171b-4f46-bd5f-8d21448da788 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6d1c0271-c6bf-4778-9ce0-8f09639c370f req-44f4b750-171b-4f46-bd5f-8d21448da788 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6d1c0271-c6bf-4778-9ce0-8f09639c370f req-44f4b750-171b-4f46-bd5f-8d21448da788 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Processing event network-vif-plugged-4d1f24c3-d7a8-450a-92d5-0e807355b791 {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6d1c0271-c6bf-4778-9ce0-8f09639c370f req-44f4b750-171b-4f46-bd5f-8d21448da788 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-plugged-4d1f24c3-d7a8-450a-92d5-0e807355b791 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6d1c0271-c6bf-4778-9ce0-8f09639c370f req-44f4b750-171b-4f46-bd5f-8d21448da788 service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6d1c0271-c6bf-4778-9ce0-8f09639c370f req-44f4b750-171b-4f46-bd5f-8d21448da788 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6d1c0271-c6bf-4778-9ce0-8f09639c370f req-44f4b750-171b-4f46-bd5f-8d21448da788 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6d1c0271-c6bf-4778-9ce0-8f09639c370f req-44f4b750-171b-4f46-bd5f-8d21448da788 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] No event matching network-vif-plugged-4d1f24c3-d7a8-450a-92d5-0e807355b791 in dict_keys([('network-vif-plugged', '789bf2ca-f86e-403a-88a3-0103291a84df'), ('network-vif-plugged', '40295919-4c2c-4e1e-be95-73e18d612ce4'), ('network-vif-plugged', 'f002d56c-77f0-4fb0-9501-751106b08f89')]) {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-6d1c0271-c6bf-4778-9ce0-8f09639c370f req-44f4b750-171b-4f46-bd5f-8d21448da788 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received unexpected event network-vif-plugged-4d1f24c3-d7a8-450a-92d5-0e807355b791 for instance with vm_state building and task_state spawning. Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Successfully created port: 22fd01da-9056-4cd0-8489-c9f005bb66a5 {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: INFO nova.scheduler.client.report [None req-15f152ae-8589-4dc4-afa9-b7132c575a18 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Deleted allocations for instance 5e52bd75-8566-4472-8147-99655013bc83 Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Creating config drive at /opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5/disk.config Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp22bc4nvr {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp22bc4nvr" returned: 0 in 0.045s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:48.094598 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Releasing lock "refresh_cache-775ef107-e7ca-4d94-b5ab-2ec8665a4906" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:42:48.098658 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Instance network_info: |[{"id": "93cdbb39-15d6-4bb1-a55a-bccc139ac288", "address": "fa:16:3e:07:f4:ac", "network": {"id": "d59f1de2-a0fd-4318-9724-66a1bbe8ec86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-557005970-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "00cdd814e374462e9477baf02d6c2fdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93cdbb39-15", "ovs_interfaceid": "93cdbb39-15d6-4bb1-a55a-bccc139ac288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 25 04:42:48.098658 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Start _get_guest_xml network_info=[{"id": "93cdbb39-15d6-4bb1-a55a-bccc139ac288", "address": "fa:16:3e:07:f4:ac", "network": {"id": "d59f1de2-a0fd-4318-9724-66a1bbe8ec86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-557005970-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "00cdd814e374462e9477baf02d6c2fdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93cdbb39-15", "ovs_interfaceid": "93cdbb39-15d6-4bb1-a55a-bccc139ac288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '4ecaf199-c1b9-4ce3-869c-178c170c1662'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:42:48.098658 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:42:48.098658 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-1193770806', uuid='775ef107-e7ca-4d94-b5ab-2ec8665a4906'), owner=OwnerMeta(userid='7f9bd46f11cd4d38bbf9926be137ca8e', username='tempest-VolumesActionsTest-93709413-project-member', projectid='00cdd814e374462e9477baf02d6c2fdb', projectname='tempest-VolumesActionsTest-93709413'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "93cdbb39-15d6-4bb1-a55a-bccc139ac288", "address": "fa:16:3e:07:f4:ac", "network": {"id": "d59f1de2-a0fd-4318-9724-66a1bbe8ec86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-557005970-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "00cdd814e374462e9477baf02d6c2fdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93cdbb39-15", "ovs_interfaceid": "93cdbb39-15d6-4bb1-a55a-bccc139ac288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362567.7362547) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:42:48.098658 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:42:48.098658 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:42:48.098658 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:42:48.098658 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:42:48.098658 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:42:48.098658 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:42:48.098658 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:42:48.098658 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:42:48.098658 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:42:48.098658 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:42:48.098658 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:42:48.098658 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:42:48.098658 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:42:48.098658 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:42:48.098658 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:42:48.098658 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:42:48.103064 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:42:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1193770806',display_name='tempest-VolumesActionsTest-instance-1193770806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-volumesactionstest-instance-1193770806',id=11,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00cdd814e374462e9477baf02d6c2fdb',ramdisk_id='',reservation_id='r-itvpglhh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-93709413',owner_user_name='tempest-VolumesActionsTest-93709413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:44Z,user_data=None,user_id='7f9bd46f11cd4d38bbf9926be137ca8e',uuid=775ef107-e7ca-4d94-b5ab-2ec8665a4906,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93cdbb39-15d6-4bb1-a55a-bccc139ac288", "address": "fa:16:3e:07:f4:ac", "network": {"id": "d59f1de2-a0fd-4318-9724-66a1bbe8ec86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-557005970-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "00cdd814e374462e9477baf02d6c2fdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93cdbb39-15", "ovs_interfaceid": "93cdbb39-15d6-4bb1-a55a-bccc139ac288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:42:48.103064 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Converting VIF {"id": "93cdbb39-15d6-4bb1-a55a-bccc139ac288", "address": "fa:16:3e:07:f4:ac", "network": {"id": "d59f1de2-a0fd-4318-9724-66a1bbe8ec86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-557005970-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "00cdd814e374462e9477baf02d6c2fdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93cdbb39-15", "ovs_interfaceid": "93cdbb39-15d6-4bb1-a55a-bccc139ac288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:42:48.103064 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:f4:ac,bridge_name='br-int',has_traffic_filtering=True,id=93cdbb39-15d6-4bb1-a55a-bccc139ac288,network=Network(d59f1de2-a0fd-4318-9724-66a1bbe8ec86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93cdbb39-15') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:42:48.103064 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lazy-loading 'pci_devices' on Instance uuid 775ef107-e7ca-4d94-b5ab-2ec8665a4906 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:48.103064 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:42:48.103064 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9c033870-f167-4235-86ff-98005452a16c] VM Started (Lifecycle Event) Jun 25 04:42:48.103064 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:48.103064 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:48.103064 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:48.103064 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:48.103064 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:48.184682 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Start building block device mappings for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 25 04:42:48.229449 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:48.235529 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0f40b47-aa78-4b1e-8676-ad5209c3a86e tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "19180a23-a7e0-4354-b9f4-9ca57062fc06" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 6.647s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:48.267337 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:48.272056 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] End _get_guest_xml xml= Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: 775ef107-e7ca-4d94-b5ab-2ec8665a4906 Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: instance-0000000b Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: 196608 Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: tempest-VolumesActionsTest-instance-1193770806 Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: 2026-06-25 04:42:47 Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: 192 Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: 0 Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: 0 Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: True Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: bare Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: 0 Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: virtio Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: tempest-VolumesActionsTest-93709413-project-member Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: tempest-VolumesActionsTest-93709413 Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: 775ef107-e7ca-4d94-b5ab-2ec8665a4906 Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: 775ef107-e7ca-4d94-b5ab-2ec8665a4906 Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: hvm Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: 128 Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: 1 Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: Jun 25 04:42:48.281229 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:42:48.284183 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Preparing to wait for external event network-vif-plugged-93cdbb39-15d6-4bb1-a55a-bccc139ac288 {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:42:48.284183 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Acquiring lock "775ef107-e7ca-4d94-b5ab-2ec8665a4906-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:48.284183 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "775ef107-e7ca-4d94-b5ab-2ec8665a4906-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:48.284183 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "775ef107-e7ca-4d94-b5ab-2ec8665a4906-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:48.284183 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:42:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1193770806',display_name='tempest-VolumesActionsTest-instance-1193770806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-volumesactionstest-instance-1193770806',id=11,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00cdd814e374462e9477baf02d6c2fdb',ramdisk_id='',reservation_id='r-itvpglhh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-93709413',owner_user_name='tempest-VolumesActionsTest-93709413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:44Z,user_data=None,user_id='7f9bd46f11cd4d38bbf9926be137ca8e',uuid=775ef107-e7ca-4d94-b5ab-2ec8665a4906,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93cdbb39-15d6-4bb1-a55a-bccc139ac288", "address": "fa:16:3e:07:f4:ac", "network": {"id": "d59f1de2-a0fd-4318-9724-66a1bbe8ec86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-557005970-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "00cdd814e374462e9477baf02d6c2fdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93cdbb39-15", "ovs_interfaceid": "93cdbb39-15d6-4bb1-a55a-bccc139ac288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:42:48.284183 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Converting VIF {"id": "93cdbb39-15d6-4bb1-a55a-bccc139ac288", "address": "fa:16:3e:07:f4:ac", "network": {"id": "d59f1de2-a0fd-4318-9724-66a1bbe8ec86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-557005970-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "00cdd814e374462e9477baf02d6c2fdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93cdbb39-15", "ovs_interfaceid": "93cdbb39-15d6-4bb1-a55a-bccc139ac288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:42:48.284183 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:f4:ac,bridge_name='br-int',has_traffic_filtering=True,id=93cdbb39-15d6-4bb1-a55a-bccc139ac288,network=Network(d59f1de2-a0fd-4318-9724-66a1bbe8ec86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93cdbb39-15') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:42:48.284645 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:f4:ac,bridge_name='br-int',has_traffic_filtering=True,id=93cdbb39-15d6-4bb1-a55a-bccc139ac288,network=Network(d59f1de2-a0fd-4318-9724-66a1bbe8ec86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93cdbb39-15') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:42:48.285666 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:48.289099 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:48.289437 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:42:48.291250 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:48.291479 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd83b3071-4c36-5e29-979c-b5c0b48faa46', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:48.292330 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:48.293169 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:48.293639 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:48.296171 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:48.296171 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93cdbb39-15, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:48.296719 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93cdbb39-15, col_values=(('qos', UUID('eae62767-bddb-46fd-b829-73a6ef42d823')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:48.296920 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93cdbb39-15, col_values=(('external_ids', {'iface-id': '93cdbb39-15d6-4bb1-a55a-bccc139ac288', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:f4:ac', 'vm-uuid': '775ef107-e7ca-4d94-b5ab-2ec8665a4906'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:48.298034 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:48.299917 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:48.301492 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-ba25a7e8-a1f6-417f-a4dc-3805ad5eaecc tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:42:48.302011 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-ba25a7e8-a1f6-417f-a4dc-3805ad5eaecc tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:42:48.309585 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:48.309585 np0000003587 nova-compute[98952]: INFO os_vif [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:f4:ac,bridge_name='br-int',has_traffic_filtering=True,id=93cdbb39-15d6-4bb1-a55a-bccc139ac288,network=Network(d59f1de2-a0fd-4318-9724-66a1bbe8ec86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93cdbb39-15') Jun 25 04:42:48.331178 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9c033870-f167-4235-86ff-98005452a16c] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:48.338375 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Paused> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:42:48.338497 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9c033870-f167-4235-86ff-98005452a16c] VM Paused (Lifecycle Event) Jun 25 04:42:48.344570 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1329866f-849e-41dc-94ab-895c2af7dffd req-5288915e-e8f7-4203-bebd-a0d3d2753e1d service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-plugged-e12da27e-2953-4784-80b6-5f7204f4e399 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:48.344808 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1329866f-849e-41dc-94ab-895c2af7dffd req-5288915e-e8f7-4203-bebd-a0d3d2753e1d service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:48.344969 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1329866f-849e-41dc-94ab-895c2af7dffd req-5288915e-e8f7-4203-bebd-a0d3d2753e1d service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:48.345201 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1329866f-849e-41dc-94ab-895c2af7dffd req-5288915e-e8f7-4203-bebd-a0d3d2753e1d service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:48.345673 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1329866f-849e-41dc-94ab-895c2af7dffd req-5288915e-e8f7-4203-bebd-a0d3d2753e1d service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] No event matching network-vif-plugged-e12da27e-2953-4784-80b6-5f7204f4e399 in dict_keys([('network-vif-plugged', '789bf2ca-f86e-403a-88a3-0103291a84df'), ('network-vif-plugged', '40295919-4c2c-4e1e-be95-73e18d612ce4'), ('network-vif-plugged', 'f002d56c-77f0-4fb0-9501-751106b08f89')]) {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 25 04:42:48.345859 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-1329866f-849e-41dc-94ab-895c2af7dffd req-5288915e-e8f7-4203-bebd-a0d3d2753e1d service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received unexpected event network-vif-plugged-e12da27e-2953-4784-80b6-5f7204f4e399 for instance with vm_state building and task_state spawning. Jun 25 04:42:48.345989 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1329866f-849e-41dc-94ab-895c2af7dffd req-5288915e-e8f7-4203-bebd-a0d3d2753e1d service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-plugged-f002d56c-77f0-4fb0-9501-751106b08f89 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:48.346129 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1329866f-849e-41dc-94ab-895c2af7dffd req-5288915e-e8f7-4203-bebd-a0d3d2753e1d service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:48.346271 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1329866f-849e-41dc-94ab-895c2af7dffd req-5288915e-e8f7-4203-bebd-a0d3d2753e1d service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:48.346404 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1329866f-849e-41dc-94ab-895c2af7dffd req-5288915e-e8f7-4203-bebd-a0d3d2753e1d service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:48.346581 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1329866f-849e-41dc-94ab-895c2af7dffd req-5288915e-e8f7-4203-bebd-a0d3d2753e1d service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Processing event network-vif-plugged-f002d56c-77f0-4fb0-9501-751106b08f89 {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:42:48.346735 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1329866f-849e-41dc-94ab-895c2af7dffd req-5288915e-e8f7-4203-bebd-a0d3d2753e1d service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-plugged-f002d56c-77f0-4fb0-9501-751106b08f89 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:48.347179 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1329866f-849e-41dc-94ab-895c2af7dffd req-5288915e-e8f7-4203-bebd-a0d3d2753e1d service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:48.347179 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1329866f-849e-41dc-94ab-895c2af7dffd req-5288915e-e8f7-4203-bebd-a0d3d2753e1d service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:48.347179 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1329866f-849e-41dc-94ab-895c2af7dffd req-5288915e-e8f7-4203-bebd-a0d3d2753e1d service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:48.347389 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1329866f-849e-41dc-94ab-895c2af7dffd req-5288915e-e8f7-4203-bebd-a0d3d2753e1d service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] No event matching network-vif-plugged-f002d56c-77f0-4fb0-9501-751106b08f89 in dict_keys([('network-vif-plugged', '789bf2ca-f86e-403a-88a3-0103291a84df'), ('network-vif-plugged', '40295919-4c2c-4e1e-be95-73e18d612ce4')]) {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 25 04:42:48.347389 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-1329866f-849e-41dc-94ab-895c2af7dffd req-5288915e-e8f7-4203-bebd-a0d3d2753e1d service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received unexpected event network-vif-plugged-f002d56c-77f0-4fb0-9501-751106b08f89 for instance with vm_state building and task_state spawning. Jun 25 04:42:48.355363 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:48.363809 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:48.386395 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:48.396757 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Successfully created port: a7d7f523-bf9e-4f8f-881d-9d05c514eb54 {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:42:48.431762 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:48.518094 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:48.518682 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:48.537474 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:48.546883 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:48.548808 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-15f152ae-8589-4dc4-afa9-b7132c575a18 tempest-AttachSCSIVolumeTestJSON-717482791 tempest-AttachSCSIVolumeTestJSON-717482791-project-member] Lock "5e52bd75-8566-4472-8147-99655013bc83" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 10.719s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:48.612838 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:48.617458 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] skipping disk /dev/dm-6 (vda) as it is a volume {{(pid=98952) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 25 04:42:48.617458 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=98952) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 25 04:42:48.617458 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] skipping disk /dev/dm-5 (vdc) as it is a volume {{(pid=98952) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 25 04:42:48.621093 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19180a23-a7e0-4354-b9f4-9ca57062fc06/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:48.692587 np0000003587 nova-compute[98952]: INFO nova.virt.block_device [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Booting with volume 94315545-1fac-434f-9971-01dd561f2296 at /dev/vda Jun 25 04:42:48.711284 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19180a23-a7e0-4354-b9f4-9ca57062fc06/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:48.712019 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19180a23-a7e0-4354-b9f4-9ca57062fc06/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:48.758895 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.80', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003587', 'execute': None}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:42:48.775738 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.scaleio [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98952) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 25 04:42:48.803593 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Running cmd (subprocess): nvme version {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:48.816006 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-ba25a7e8-a1f6-417f-a4dc-3805ad5eaecc tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:42:48.827576 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19180a23-a7e0-4354-b9f4-9ca57062fc06/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:48.830507 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] skipping disk /dev/dm-9 (vdb) as it is a volume {{(pid=98952) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 25 04:42:48.835891 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98952) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 25 04:42:48.836632 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] 'nvme version' failed. Not Retrying. {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 04:42:48.836960 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] nvme not present on system {{(pid=98952) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 25 04:42:48.838164 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:48.852353 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9c033870-f167-4235-86ff-98005452a16c] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:48.868360 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9c033870-f167-4235-86ff-98005452a16c] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:42:48.868819 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98952) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 25 04:42:48.871628 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.lightos [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Current host hostNQN and IP(s) are ['10.4.3.80', 'fe80::f816:3eff:feea:dfe4', '192.168.40.6', 'fe80::f816:3eff:fe4f:7c42', '192.168.50.6', 'fe80::f816:3eff:fe6c:e6a6', '192.168.10.6', 'fe80::f816:3eff:fe17:d749', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::b035:28ff:fe70:6f4a', 'fe80::fc16:3eff:fe8c:f883', 'fe80::483f:f2ff:fe48:75ca', 'fe80::fc16:3eff:fe78:7ac8', 'fe80::1038:1dff:fe1c:d44b', 'fe80::fc16:3eff:fe3a:4858', 'fe80::fc16:3eff:fe4f:4083', 'fe80::fc16:3eff:fee6:e022', 'fe80::fc16:3eff:feab:c3d8', 'fe80::bca6:aaff:fef0:a5cf', 'fe80::fc16:3eff:fe6d:cc4e', 'fe80::fc16:3eff:fe07:d0f0', 'fe80::fc16:3eff:fee6:936b', 'fe80::fc16:3eff:fed3:389d', 'fe80::fc16:3eff:fe06:1da0', 'fe80::6086:d2ff:fe1e:62e1', 'fe80::fc16:3eff:fefe:a095', 'fe80::b4c2:93ff:fe6e:4d89', 'fe80::fc16:3eff:feee:97a2'] Jun 25 04:42:48.871987 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 25 04:42:48.871987 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] LIGHTOS: no hostnqn found. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 25 04:42:48.872820 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.80', 'host': 'np0000003587', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c81886224652', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a1feb13-40e2-4ac6-989e-b08a6fc0f283', 'nvme_native_multipath': False} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:42:48.872820 np0000003587 nova-compute[98952]: DEBUG nova.virt.block_device [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Updating existing volume attachment record: eb426105-361d-467b-9d30-287b6a8952c6 {{(pid=98952) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 25 04:42:48.884416 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-e31f1c47-16b1-4b6f-8733-47edc223274a req-c0796766-c898-45af-b1c2-a4c8c26209f2 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-plugged-aa227a29-8d0b-49f2-a71e-233ba6d38b79 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:48.884994 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-e31f1c47-16b1-4b6f-8733-47edc223274a req-c0796766-c898-45af-b1c2-a4c8c26209f2 service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:48.885274 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-e31f1c47-16b1-4b6f-8733-47edc223274a req-c0796766-c898-45af-b1c2-a4c8c26209f2 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:48.885437 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-e31f1c47-16b1-4b6f-8733-47edc223274a req-c0796766-c898-45af-b1c2-a4c8c26209f2 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:48.885698 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-e31f1c47-16b1-4b6f-8733-47edc223274a req-c0796766-c898-45af-b1c2-a4c8c26209f2 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] No event matching network-vif-plugged-aa227a29-8d0b-49f2-a71e-233ba6d38b79 in dict_keys([('network-vif-plugged', '789bf2ca-f86e-403a-88a3-0103291a84df'), ('network-vif-plugged', '40295919-4c2c-4e1e-be95-73e18d612ce4')]) {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 25 04:42:48.885901 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-e31f1c47-16b1-4b6f-8733-47edc223274a req-c0796766-c898-45af-b1c2-a4c8c26209f2 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received unexpected event network-vif-plugged-aa227a29-8d0b-49f2-a71e-233ba6d38b79 for instance with vm_state building and task_state spawning. Jun 25 04:42:48.932018 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:48.932486 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:48.949329 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Successfully created port: ed1393f8-f25b-489d-9635-82b920d33137 {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:42:49.017845 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:49.023719 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98952) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 25 04:42:49.028334 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:49.065891 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-12de2840-d4f7-4ede-b748-995ab7a4a73d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:49.066579 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-12de2840-d4f7-4ede-b748-995ab7a4a73d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:49.117839 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:49.118356 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:49.204200 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:49.205168 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] skipping disk /dev/dm-9 (vdb) as it is a volume {{(pid=98952) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 25 04:42:49.209117 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:42:49.210339 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:49.245639 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "env LANG=C uptime" returned: 0 in 0.034s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:49.246653 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Hypervisor/Node resource view: name=np0000003587 free_ram=51431MB free_disk=74.3936538696289GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98952) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 25 04:42:49.247449 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:49.331406 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ba25a7e8-a1f6-417f-a4dc-3805ad5eaecc tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.905s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:49.334979 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.088s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:49.389691 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9c033870-f167-4235-86ff-98005452a16c] During sync_power_state the instance has a pending task (spawning). Skip. Jun 25 04:42:49.390152 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:42:49.391125 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] VM Started (Lifecycle Event) Jun 25 04:42:49.420888 np0000003587 nova-compute[98952]: INFO nova.scheduler.client.report [None req-ba25a7e8-a1f6-417f-a4dc-3805ad5eaecc tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Deleted allocations for instance 54721bc9-c45c-4cb1-9910-f47334e84cd2 Jun 25 04:42:49.468436 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Successfully created port: 2af2f66c-7de8-49e4-badd-16d0764caff6 {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:42:49.558079 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-plugged-789bf2ca-f86e-403a-88a3-0103291a84df {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:49.558941 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:49.559128 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:49.559324 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:49.559579 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Processing event network-vif-plugged-789bf2ca-f86e-403a-88a3-0103291a84df {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:42:49.559854 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-plugged-789bf2ca-f86e-403a-88a3-0103291a84df {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:49.560166 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:49.560367 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:49.560518 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:49.561114 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] No event matching network-vif-plugged-789bf2ca-f86e-403a-88a3-0103291a84df in dict_keys([('network-vif-plugged', '40295919-4c2c-4e1e-be95-73e18d612ce4')]) {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 25 04:42:49.561355 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received unexpected event network-vif-plugged-789bf2ca-f86e-403a-88a3-0103291a84df for instance with vm_state building and task_state spawning. Jun 25 04:42:49.561461 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-plugged-40295919-4c2c-4e1e-be95-73e18d612ce4 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:49.561669 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:49.561831 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:49.561971 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:49.562128 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Processing event network-vif-plugged-40295919-4c2c-4e1e-be95-73e18d612ce4 {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:42:49.562302 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-plugged-40295919-4c2c-4e1e-be95-73e18d612ce4 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:49.563036 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Instance event wait completed in 1 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:42:49.563325 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:49.563471 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:49.563698 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:49.563753 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] No waiting events found dispatching network-vif-plugged-40295919-4c2c-4e1e-be95-73e18d612ce4 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:42:49.563852 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received unexpected event network-vif-plugged-40295919-4c2c-4e1e-be95-73e18d612ce4 for instance with vm_state building and task_state spawning. Jun 25 04:42:49.563954 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Received event network-vif-plugged-53b9a3dd-c125-4e7b-b3ee-9debd47394dd {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:49.564057 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] Acquiring lock "1b412363-2fb7-4469-b748-80cc52825bb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:49.564195 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] Lock "1b412363-2fb7-4469-b748-80cc52825bb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:49.564286 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] Lock "1b412363-2fb7-4469-b748-80cc52825bb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:49.565124 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Processing event network-vif-plugged-53b9a3dd-c125-4e7b-b3ee-9debd47394dd {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:42:49.565124 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Received event network-vif-plugged-53b9a3dd-c125-4e7b-b3ee-9debd47394dd {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:49.565124 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] Acquiring lock "1b412363-2fb7-4469-b748-80cc52825bb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:49.565124 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] Lock "1b412363-2fb7-4469-b748-80cc52825bb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:49.565124 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] Lock "1b412363-2fb7-4469-b748-80cc52825bb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:49.565124 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] No waiting events found dispatching network-vif-plugged-53b9a3dd-c125-4e7b-b3ee-9debd47394dd {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:42:49.565393 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-95889725-1c54-4a96-bc19-21d5edae7ee8 req-fdc4887a-2603-4e6e-b375-485fc8ec8b2f service nova] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Received unexpected event network-vif-plugged-53b9a3dd-c125-4e7b-b3ee-9debd47394dd for instance with vm_state building and task_state spawning. Jun 25 04:42:49.565725 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:42:49.566640 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Guest created on hypervisor {{(pid=98952) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 25 04:42:49.570270 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Guest created on hypervisor {{(pid=98952) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 25 04:42:49.571805 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-12de2840-d4f7-4ede-b748-995ab7a4a73d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Detaching volume 9ed8d9ce-b06c-4856-91a6-090a64fd59c4 Jun 25 04:42:49.577989 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 9c033870-f167-4235-86ff-98005452a16c] Instance spawned successfully. Jun 25 04:42:49.578798 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 25 04:42:49.585205 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Instance spawned successfully. Jun 25 04:42:49.585792 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 25 04:42:49.657120 np0000003587 nova-compute[98952]: INFO nova.virt.block_device [None req-12de2840-d4f7-4ede-b748-995ab7a4a73d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d] Attempting to driver detach volume 9ed8d9ce-b06c-4856-91a6-090a64fd59c4 from mountpoint /dev/vdb Jun 25 04:42:49.661195 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-12de2840-d4f7-4ede-b748-995ab7a4a73d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Found disk vdb by alias ua-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 {{(pid=98952) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 25 04:42:49.663078 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-12de2840-d4f7-4ede-b748-995ab7a4a73d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Found disk vdb by alias ua-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 {{(pid=98952) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 25 04:42:49.663078 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-12de2840-d4f7-4ede-b748-995ab7a4a73d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Attempting to detach device vdb from instance 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d from the persistent domain config. {{(pid=98952) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 25 04:42:49.663803 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-12de2840-d4f7-4ede-b748-995ab7a4a73d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] detach device xml: Jun 25 04:42:49.663803 np0000003587 nova-compute[98952]: Jun 25 04:42:49.663803 np0000003587 nova-compute[98952]: Jun 25 04:42:49.663803 np0000003587 nova-compute[98952]: Jun 25 04:42:49.663803 np0000003587 nova-compute[98952]: Jun 25 04:42:49.663803 np0000003587 nova-compute[98952]: 9ed8d9ce-b06c-4856-91a6-090a64fd59c4 Jun 25 04:42:49.663803 np0000003587 nova-compute[98952]: Jun 25 04:42:49.663803 np0000003587 nova-compute[98952]:
Jun 25 04:42:49.663803 np0000003587 nova-compute[98952]: Jun 25 04:42:49.663803 np0000003587 nova-compute[98952]: {{(pid=98952) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 25 04:42:49.669721 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-12de2840-d4f7-4ede-b748-995ab7a4a73d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Successfully detached device vdb from instance 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d from the persistent domain config. Jun 25 04:42:49.669721 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-12de2840-d4f7-4ede-b748-995ab7a4a73d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] (1/8): Attempting to detach device vdb with device alias ua-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 from instance 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d from the live domain config. {{(pid=98952) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 25 04:42:49.670140 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-12de2840-d4f7-4ede-b748-995ab7a4a73d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] detach device xml: Jun 25 04:42:49.670140 np0000003587 nova-compute[98952]: Jun 25 04:42:49.670140 np0000003587 nova-compute[98952]: Jun 25 04:42:49.670140 np0000003587 nova-compute[98952]: Jun 25 04:42:49.670140 np0000003587 nova-compute[98952]: Jun 25 04:42:49.670140 np0000003587 nova-compute[98952]: 9ed8d9ce-b06c-4856-91a6-090a64fd59c4 Jun 25 04:42:49.670140 np0000003587 nova-compute[98952]: Jun 25 04:42:49.670140 np0000003587 nova-compute[98952]:
Jun 25 04:42:49.670140 np0000003587 nova-compute[98952]: Jun 25 04:42:49.670140 np0000003587 nova-compute[98952]: {{(pid=98952) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 25 04:42:49.864165 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:49.896768 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:49.898947 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:42:49.974180 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:42:49.974180 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:42:49.974180 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] No VIF found with MAC fa:16:3e:07:f4:ac, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:42:49.974180 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Using config drive Jun 25 04:42:50.095957 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Found default for hw_cdrom_bus of ide {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:50.096208 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Found default for hw_disk_bus of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:50.096675 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Found default for hw_input_bus of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:50.098720 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Found default for hw_pointer_model of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:50.099793 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Found default for hw_cdrom_bus of ide {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:50.100199 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Found default for hw_video_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:50.101260 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Found default for hw_disk_bus of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:50.101260 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Found default for hw_vif_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:50.105634 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Found default for hw_input_bus of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:50.107249 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Found default for hw_pointer_model of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:50.107249 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Found default for hw_video_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:50.107249 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Found default for hw_vif_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:50.149785 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Successfully created port: 07a46cd4-912b-4863-8b8f-f345fe260bd0 {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:42:50.401692 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] During sync_power_state the instance has a pending task (spawning). Skip. Jun 25 04:42:50.402026 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Paused> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:42:50.402214 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] VM Paused (Lifecycle Event) Jun 25 04:42:50.420504 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 11145d6a-7a4f-4b00-8543-d9b51514d9de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:42:50.422032 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 9333a704-82ad-4b54-8456-59eb035a2512 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:42:50.422167 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:42:50.422340 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 9aa3370c-9525-460d-b6fc-40a6461bd725 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:42:50.423264 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 9c033870-f167-4235-86ff-98005452a16c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:42:50.423264 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 19180a23-a7e0-4354-b9f4-9ca57062fc06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:42:50.423264 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 1b412363-2fb7-4469-b748-80cc52825bb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:42:50.423264 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 775ef107-e7ca-4d94-b5ab-2ec8665a4906 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:42:50.423264 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:42:50.424464 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Total usable vcpus: 16, total allocated vcpus: 9 {{(pid=98952) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 25 04:42:50.424464 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Final resource view: name=np0000003587 phys_ram=64301MB used_ram=2240MB phys_disk=95GB used_disk=5GB total_vcpus=16 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:42:49 up 28 min, 2 users, load average: 9.88, 4.77, 2.16\n', 'num_instances': '9', 'num_vm_active': '5', 'num_task_None': '5', 'num_os_type_None': '9', 'num_proj_a5d52ed3b8de460eb65a8fb4ad1b015d': '3', 'io_workload': '4', 'num_proj_284d191aa82f453cabcfd18172f74099': '3', 'num_vm_building': '4', 'num_task_spawning': '3', 'num_proj_1c1a4dead6ad4de1bb75262d9c52bbee': '1', 'num_proj_00cdd814e374462e9477baf02d6c2fdb': '1', 'num_task_block_device_mapping': '1', 'num_proj_40a42527a8b24135b741fe2c38dc14b0': '1'} {{(pid=98952) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 25 04:42:50.426852 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-12de2840-d4f7-4ede-b748-995ab7a4a73d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 for instance 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d {{(pid=98952) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 25 04:42:50.433666 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ba25a7e8-a1f6-417f-a4dc-3805ad5eaecc tempest-VolumesAssistedSnapshotsTest-382681988 tempest-VolumesAssistedSnapshotsTest-382681988-project-member] Lock "54721bc9-c45c-4cb1-9910-f47334e84cd2" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.411s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:50.485939 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:50.520935 np0000003587 nova-compute[98952]: INFO nova.virt.block_device [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Booting with volume a08f66b0-7f9c-47e4-9418-275768fa9e0e at /dev/vdb Jun 25 04:42:50.615796 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Took 8.00 seconds to spawn the instance on the hypervisor. Jun 25 04:42:50.615796 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:50.616371 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.80', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003587', 'execute': None}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:42:50.621887 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Took 33.96 seconds to spawn the instance on the hypervisor. Jun 25 04:42:50.626582 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:50.653328 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.scaleio [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98952) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 25 04:42:50.687757 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Running cmd (subprocess): nvme version {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:50.738620 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] 'nvme version' failed. Not Retrying. {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 04:42:50.741167 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] nvme not present on system {{(pid=98952) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 25 04:42:50.755241 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98952) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 25 04:42:50.761821 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.lightos [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Current host hostNQN and IP(s) are ['10.4.3.80', 'fe80::f816:3eff:feea:dfe4', '192.168.40.6', 'fe80::f816:3eff:fe4f:7c42', '192.168.50.6', 'fe80::f816:3eff:fe6c:e6a6', '192.168.10.6', 'fe80::f816:3eff:fe17:d749', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::b035:28ff:fe70:6f4a', 'fe80::fc16:3eff:fe8c:f883', 'fe80::483f:f2ff:fe48:75ca', 'fe80::fc16:3eff:fe78:7ac8', 'fe80::1038:1dff:fe1c:d44b', 'fe80::fc16:3eff:fe3a:4858', 'fe80::fc16:3eff:fe4f:4083', 'fe80::fc16:3eff:fee6:e022', 'fe80::fc16:3eff:feab:c3d8', 'fe80::bca6:aaff:fef0:a5cf', 'fe80::fc16:3eff:fe6d:cc4e', 'fe80::fc16:3eff:fe07:d0f0', 'fe80::fc16:3eff:fee6:936b', 'fe80::fc16:3eff:fed3:389d', 'fe80::fc16:3eff:fe06:1da0', 'fe80::6086:d2ff:fe1e:62e1', 'fe80::fc16:3eff:fefe:a095', 'fe80::b4c2:93ff:fe6e:4d89', 'fe80::fc16:3eff:feee:97a2'] Jun 25 04:42:50.761984 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 25 04:42:50.763574 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] LIGHTOS: no hostnqn found. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 25 04:42:50.763574 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.80', 'host': 'np0000003587', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c81886224652', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a1feb13-40e2-4ac6-989e-b08a6fc0f283', 'nvme_native_multipath': False} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:42:50.763574 np0000003587 nova-compute[98952]: DEBUG nova.virt.block_device [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Updating existing volume attachment record: e00e5819-36b1-4e03-8783-d7cb0fc9f7d7 {{(pid=98952) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 25 04:42:50.777843 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Creating config drive at /opt/stack/data/nova/instances/775ef107-e7ca-4d94-b5ab-2ec8665a4906/disk.config Jun 25 04:42:50.788813 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/775ef107-e7ca-4d94-b5ab-2ec8665a4906/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnxjs3w_b {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:50.838649 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/775ef107-e7ca-4d94-b5ab-2ec8665a4906/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnxjs3w_b" returned: 0 in 0.049s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:50.905728 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:50.911293 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:42:50.911626 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9c033870-f167-4235-86ff-98005452a16c] VM Resumed (Lifecycle Event) Jun 25 04:42:50.946295 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Successfully updated port: 22fd01da-9056-4cd0-8489-c9f005bb66a5 {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:42:51.152865 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Took 46.32 seconds to build instance. Jun 25 04:42:51.153970 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Took 13.91 seconds to build instance. Jun 25 04:42:51.247443 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:42:51.247750 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:42:51.349660 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:51.401844 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:51.401844 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:51.415591 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9c033870-f167-4235-86ff-98005452a16c] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:51.417958 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 9c033870-f167-4235-86ff-98005452a16c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:42:51.522029 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:51.656120 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "1b412363-2fb7-4469-b748-80cc52825bb5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.416s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:51.660011 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2af45a99-a690-4b92-add5-c38f7d333006 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "9c033870-f167-4235-86ff-98005452a16c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 47.834s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:51.660596 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-715a1dbf-ad01-4cef-8b54-77ecb781c005 req-6b97ae1b-06ee-48e2-80ef-b11fbbe3df15 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-changed-22fd01da-9056-4cd0-8489-c9f005bb66a5 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:51.660808 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-715a1dbf-ad01-4cef-8b54-77ecb781c005 req-6b97ae1b-06ee-48e2-80ef-b11fbbe3df15 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Refreshing instance network info cache due to event network-changed-22fd01da-9056-4cd0-8489-c9f005bb66a5. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:42:51.661475 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-715a1dbf-ad01-4cef-8b54-77ecb781c005 req-6b97ae1b-06ee-48e2-80ef-b11fbbe3df15 service nova] Acquiring lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:51.661475 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-715a1dbf-ad01-4cef-8b54-77ecb781c005 req-6b97ae1b-06ee-48e2-80ef-b11fbbe3df15 service nova] Acquired lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:42:51.661475 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-715a1dbf-ad01-4cef-8b54-77ecb781c005 req-6b97ae1b-06ee-48e2-80ef-b11fbbe3df15 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Refreshing network info cache for port 22fd01da-9056-4cd0-8489-c9f005bb66a5 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:42:51.752674 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:42:51.789393 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-ec052bd4-a908-42a7-8846-abe9630744c5 req-c54a91ea-ccb7-41fd-adea-e23a3b5c9f21 service nova] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Received event network-vif-plugged-93cdbb39-15d6-4bb1-a55a-bccc139ac288 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:51.789695 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ec052bd4-a908-42a7-8846-abe9630744c5 req-c54a91ea-ccb7-41fd-adea-e23a3b5c9f21 service nova] Acquiring lock "775ef107-e7ca-4d94-b5ab-2ec8665a4906-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:51.789918 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ec052bd4-a908-42a7-8846-abe9630744c5 req-c54a91ea-ccb7-41fd-adea-e23a3b5c9f21 service nova] Lock "775ef107-e7ca-4d94-b5ab-2ec8665a4906-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:51.790123 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ec052bd4-a908-42a7-8846-abe9630744c5 req-c54a91ea-ccb7-41fd-adea-e23a3b5c9f21 service nova] Lock "775ef107-e7ca-4d94-b5ab-2ec8665a4906-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:51.790264 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-ec052bd4-a908-42a7-8846-abe9630744c5 req-c54a91ea-ccb7-41fd-adea-e23a3b5c9f21 service nova] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Processing event network-vif-plugged-93cdbb39-15d6-4bb1-a55a-bccc139ac288 {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:42:51.837090 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:51.842386 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:51.848165 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:51.877216 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:51.927971 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:42:51.928119 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] VM Resumed (Lifecycle Event) Jun 25 04:42:52.165463 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-715a1dbf-ad01-4cef-8b54-77ecb781c005 req-6b97ae1b-06ee-48e2-80ef-b11fbbe3df15 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:52.262537 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Compute_service record updated for np0000003587:np0000003587 {{(pid=98952) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 25 04:42:52.263299 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.928s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:52.263809 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._threading.loopingcall [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 39.73 seconds {{(pid=98952) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 25 04:42:52.271438 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-715a1dbf-ad01-4cef-8b54-77ecb781c005 req-6b97ae1b-06ee-48e2-80ef-b11fbbe3df15 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:42:52.391647 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Successfully updated port: a36eb1f7-4779-4078-a224-bc487abd01a6 {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:42:52.432974 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:52.434794 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:42:52.466571 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-4d7eedad-e273-489b-a3af-f089f57c25ef req-2ceac477-0364-4b0f-88a4-9e0fbbeb74a4 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-changed-a36eb1f7-4779-4078-a224-bc487abd01a6 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:52.468373 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-4d7eedad-e273-489b-a3af-f089f57c25ef req-2ceac477-0364-4b0f-88a4-9e0fbbeb74a4 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Refreshing instance network info cache due to event network-changed-a36eb1f7-4779-4078-a224-bc487abd01a6. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:42:52.468373 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4d7eedad-e273-489b-a3af-f089f57c25ef req-2ceac477-0364-4b0f-88a4-9e0fbbeb74a4 service nova] Acquiring lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:52.478372 np0000003587 nova-compute[98952]: INFO nova.virt.block_device [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Booting with volume 88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 at /dev/vdc Jun 25 04:42:52.561695 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.80', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003587', 'execute': None}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:42:52.581092 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.scaleio [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98952) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 25 04:42:52.596889 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-715a1dbf-ad01-4cef-8b54-77ecb781c005 req-6b97ae1b-06ee-48e2-80ef-b11fbbe3df15 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:52.619528 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Running cmd (subprocess): nvme version {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:52.665460 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] 'nvme version' failed. Not Retrying. {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 04:42:52.666278 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] nvme not present on system {{(pid=98952) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 25 04:42:52.676391 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98952) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 25 04:42:52.679698 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.lightos [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Current host hostNQN and IP(s) are ['10.4.3.80', 'fe80::f816:3eff:feea:dfe4', '192.168.40.6', 'fe80::f816:3eff:fe4f:7c42', '192.168.50.6', 'fe80::f816:3eff:fe6c:e6a6', '192.168.10.6', 'fe80::f816:3eff:fe17:d749', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::b035:28ff:fe70:6f4a', 'fe80::fc16:3eff:fe8c:f883', 'fe80::483f:f2ff:fe48:75ca', 'fe80::fc16:3eff:fe78:7ac8', 'fe80::1038:1dff:fe1c:d44b', 'fe80::fc16:3eff:fe3a:4858', 'fe80::fc16:3eff:fe4f:4083', 'fe80::fc16:3eff:fee6:e022', 'fe80::fc16:3eff:feab:c3d8', 'fe80::bca6:aaff:fef0:a5cf', 'fe80::fc16:3eff:fe6d:cc4e', 'fe80::fc16:3eff:fe07:d0f0', 'fe80::fc16:3eff:fee6:936b', 'fe80::fc16:3eff:fed3:389d', 'fe80::fc16:3eff:fe06:1da0', 'fe80::6086:d2ff:fe1e:62e1', 'fe80::fc16:3eff:fefe:a095', 'fe80::b4c2:93ff:fe6e:4d89', 'fe80::fc16:3eff:feee:97a2', 'fe80::fc16:3eff:fe07:f4ac', 'fe80::a0a9:59ff:fe51:c299'] Jun 25 04:42:52.680015 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 25 04:42:52.680015 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] LIGHTOS: no hostnqn found. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 25 04:42:52.680338 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.80', 'host': 'np0000003587', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c81886224652', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a1feb13-40e2-4ac6-989e-b08a6fc0f283', 'nvme_native_multipath': False} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:42:52.680875 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:42:52.681363 np0000003587 nova-compute[98952]: DEBUG nova.virt.block_device [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Updating existing volume attachment record: f9dc2e30-00c6-402a-8a5f-924cd8e207ae {{(pid=98952) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 25 04:42:52.686092 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Guest created on hypervisor {{(pid=98952) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 25 04:42:52.694869 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Instance spawned successfully. Jun 25 04:42:52.694869 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 25 04:42:52.938469 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Received event ua-9ed8d9ce-b06c-4856-91a6-090a64fd59c4> from libvirt while the driver is waiting for it; dispatched. {{(pid=98952) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 25 04:42:52.939573 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:42:52.941341 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] VM Started (Lifecycle Event) Jun 25 04:42:52.946216 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-12de2840-d4f7-4ede-b748-995ab7a4a73d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Successfully detached device vdb from instance 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d from the live domain config. Jun 25 04:42:53.100204 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-715a1dbf-ad01-4cef-8b54-77ecb781c005 req-6b97ae1b-06ee-48e2-80ef-b11fbbe3df15 service nova] Releasing lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:42:53.101015 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4d7eedad-e273-489b-a3af-f089f57c25ef req-2ceac477-0364-4b0f-88a4-9e0fbbeb74a4 service nova] Acquired lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:42:53.101230 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-4d7eedad-e273-489b-a3af-f089f57c25ef req-2ceac477-0364-4b0f-88a4-9e0fbbeb74a4 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Refreshing network info cache for port a36eb1f7-4779-4078-a224-bc487abd01a6 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:42:53.203426 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Found default for hw_cdrom_bus of ide {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:53.205732 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Found default for hw_disk_bus of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:53.205732 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Found default for hw_input_bus of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:53.205732 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Found default for hw_pointer_model of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:53.206042 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Found default for hw_video_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:53.207578 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Found default for hw_vif_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:42:53.301899 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:53.445453 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:53.448836 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:42:53.503817 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-12de2840-d4f7-4ede-b748-995ab7a4a73d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Detected multiple connections on this host for volume: 9ed8d9ce-b06c-4856-91a6-090a64fd59c4, skipping target disconnect. Jun 25 04:42:53.607245 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-4d7eedad-e273-489b-a3af-f089f57c25ef req-2ceac477-0364-4b0f-88a4-9e0fbbeb74a4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:53.708253 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-4d7eedad-e273-489b-a3af-f089f57c25ef req-2ceac477-0364-4b0f-88a4-9e0fbbeb74a4 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:42:53.710442 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005458989999169717 future=) submitted to {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:42:53.710637 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:42:53.710777 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=4.191275764000011 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:42:53.711661 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=4.191157233000013 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:42:53.716745 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Emitting event Stopped> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:42:53.719369 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] VM Stopped (Lifecycle Event) Jun 25 04:42:53.720572 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Took 8.34 seconds to spawn the instance on the hypervisor. Jun 25 04:42:53.722810 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Successfully updated port: ff5a5c31-e634-489a-b565-418e87aaa11b {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:42:53.725155 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:53.783578 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-f5abd135-dc76-4c95-b37d-703d45d3d5ec req-37c9b72e-db66-4941-93d4-754d94e40ee5 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-changed-e12da27e-2953-4784-80b6-5f7204f4e399 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:53.783578 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-f5abd135-dc76-4c95-b37d-703d45d3d5ec req-37c9b72e-db66-4941-93d4-754d94e40ee5 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Refreshing instance network info cache due to event network-changed-e12da27e-2953-4784-80b6-5f7204f4e399. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:42:53.783578 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-f5abd135-dc76-4c95-b37d-703d45d3d5ec req-37c9b72e-db66-4941-93d4-754d94e40ee5 service nova] Acquiring lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:53.783578 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-f5abd135-dc76-4c95-b37d-703d45d3d5ec req-37c9b72e-db66-4941-93d4-754d94e40ee5 service nova] Acquired lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:42:53.783578 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-f5abd135-dc76-4c95-b37d-703d45d3d5ec req-37c9b72e-db66-4941-93d4-754d94e40ee5 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Refreshing network info cache for port e12da27e-2953-4784-80b6-5f7204f4e399 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:42:53.891058 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-fa6a94ea-f836-44fb-89ac-7b0c591a3064 req-28980ef9-69b2-4a44-8f6c-e2ca9c0eddfc service nova] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Received event network-vif-plugged-93cdbb39-15d6-4bb1-a55a-bccc139ac288 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:53.891319 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-fa6a94ea-f836-44fb-89ac-7b0c591a3064 req-28980ef9-69b2-4a44-8f6c-e2ca9c0eddfc service nova] Acquiring lock "775ef107-e7ca-4d94-b5ab-2ec8665a4906-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:53.891549 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-fa6a94ea-f836-44fb-89ac-7b0c591a3064 req-28980ef9-69b2-4a44-8f6c-e2ca9c0eddfc service nova] Lock "775ef107-e7ca-4d94-b5ab-2ec8665a4906-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:53.891713 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-fa6a94ea-f836-44fb-89ac-7b0c591a3064 req-28980ef9-69b2-4a44-8f6c-e2ca9c0eddfc service nova] Lock "775ef107-e7ca-4d94-b5ab-2ec8665a4906-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:53.891878 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-fa6a94ea-f836-44fb-89ac-7b0c591a3064 req-28980ef9-69b2-4a44-8f6c-e2ca9c0eddfc service nova] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] No waiting events found dispatching network-vif-plugged-93cdbb39-15d6-4bb1-a55a-bccc139ac288 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:42:53.892109 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-fa6a94ea-f836-44fb-89ac-7b0c591a3064 req-28980ef9-69b2-4a44-8f6c-e2ca9c0eddfc service nova] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Received unexpected event network-vif-plugged-93cdbb39-15d6-4bb1-a55a-bccc139ac288 for instance with vm_state active and task_state None. Jun 25 04:42:53.954883 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] During sync_power_state the instance has a pending task (spawning). Skip. Jun 25 04:42:53.954883 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Paused> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:42:53.954883 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] VM Paused (Lifecycle Event) Jun 25 04:42:53.976684 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-4d7eedad-e273-489b-a3af-f089f57c25ef req-2ceac477-0364-4b0f-88a4-9e0fbbeb74a4 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:54.092309 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-12de2840-d4f7-4ede-b748-995ab7a4a73d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lazy-loading 'flavor' on Instance uuid 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:54.225291 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 5e52bd75-8566-4472-8147-99655013bc83] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:54.244477 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Took 16.59 seconds to build instance. Jun 25 04:42:54.287211 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-f5abd135-dc76-4c95-b37d-703d45d3d5ec req-37c9b72e-db66-4941-93d4-754d94e40ee5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:54.340389 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-a3e63543-1b68-488c-860f-b3753f098866 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:54.458451 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:54.461831 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:42:54.462191 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] VM Resumed (Lifecycle Event) Jun 25 04:42:54.477745 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:54.479906 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4d7eedad-e273-489b-a3af-f089f57c25ef req-2ceac477-0364-4b0f-88a4-9e0fbbeb74a4 service nova] Releasing lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:42:54.580598 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-5ffb7162-0ad0-4e24-80d6-770da2675e54 req-32d3742a-9273-4942-b4fb-06f6a010777c service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-changed-ff5a5c31-e634-489a-b565-418e87aaa11b {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:54.580813 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-5ffb7162-0ad0-4e24-80d6-770da2675e54 req-32d3742a-9273-4942-b4fb-06f6a010777c service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Refreshing instance network info cache due to event network-changed-ff5a5c31-e634-489a-b565-418e87aaa11b. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:42:54.581878 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-5ffb7162-0ad0-4e24-80d6-770da2675e54 req-32d3742a-9273-4942-b4fb-06f6a010777c service nova] Acquiring lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:54.581878 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-5ffb7162-0ad0-4e24-80d6-770da2675e54 req-32d3742a-9273-4942-b4fb-06f6a010777c service nova] Acquired lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:42:54.581878 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-5ffb7162-0ad0-4e24-80d6-770da2675e54 req-32d3742a-9273-4942-b4fb-06f6a010777c service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Refreshing network info cache for port ff5a5c31-e634-489a-b565-418e87aaa11b {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:42:54.750178 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-dbc29dee-0b56-4bfb-9d9c-bcd97ee522b3 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "775ef107-e7ca-4d94-b5ab-2ec8665a4906" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 18.106s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:54.797282 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-f5abd135-dc76-4c95-b37d-703d45d3d5ec req-37c9b72e-db66-4941-93d4-754d94e40ee5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:54.831142 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Start spawning the instance on the hypervisor. {{(pid=98952) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 25 04:42:54.832302 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Creating instance directory {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 25 04:42:54.832711 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Creating image(s) Jun 25 04:42:54.833050 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Did not create local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 25 04:42:54.833050 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Ensure instance console log exists: /opt/stack/data/nova/instances/25ee71dc-21c1-4ed4-b3d4-7f8cc107a863/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:42:54.833240 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:54.833620 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:54.833620 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:54.837669 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:54.847590 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-a3e63543-1b68-488c-860f-b3753f098866 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] instance snapshotting Jun 25 04:42:54.866576 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:54.965375 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:54.966923 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:42:55.007945 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-a3e63543-1b68-488c-860f-b3753f098866 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Beginning live snapshot process Jun 25 04:42:55.016172 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-f5abd135-dc76-4c95-b37d-703d45d3d5ec req-37c9b72e-db66-4941-93d4-754d94e40ee5 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Updated VIF entry in instance network info cache for port e12da27e-2953-4784-80b6-5f7204f4e399. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:42:55.018172 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-f5abd135-dc76-4c95-b37d-703d45d3d5ec req-37c9b72e-db66-4941-93d4-754d94e40ee5 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Updating instance_info_cache with network_info: [{"id": "e12da27e-2953-4784-80b6-5f7204f4e399", "address": "fa:16:3e:ab:c3:d8", "network": {"id": "179999b1-f8ab-4073-96b7-da830d110303", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1298382094-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape12da27e-29", "ovs_interfaceid": "e12da27e-2953-4784-80b6-5f7204f4e399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e8846aa-559c-48a1-bf9a-ab431fd380ed", "address": "fa:16:3e:6d:cc:4e", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8846aa-55", "ovs_interfaceid": "7e8846aa-559c-48a1-bf9a-ab431fd380ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d1f24c3-d7a8-450a-92d5-0e807355b791", "address": "fa:16:3e:07:d0:f0", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1f24c3-d7", "ovs_interfaceid": "4d1f24c3-d7a8-450a-92d5-0e807355b791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "789bf2ca-f86e-403a-88a3-0103291a84df", "address": "fa:16:3e:e6:93:6b", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap789bf2ca-f8", "ovs_interfaceid": "789bf2ca-f86e-403a-88a3-0103291a84df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aa227a29-8d0b-49f2-a71e-233ba6d38b79", "address": "fa:16:3e:d3:38:9d", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa227a29-8d", "ovs_interfaceid": "aa227a29-8d0b-49f2-a71e-233ba6d38b79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40295919-4c2c-4e1e-be95-73e18d612ce4", "address": "fa:16:3e:06:1d:a0", "network": {"id": "9feb5d39-ce22-4ffd-b5a0-f44a21399308", "bridge": "br-int", "label": "tempest-device-tagging-net2-639540845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40295919-4c", "ovs_interfaceid": "40295919-4c2c-4e1e-be95-73e18d612ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f002d56c-77f0-4fb0-9501-751106b08f89", "address": "fa:16:3e:fe:a0:95", "network": {"id": "9feb5d39-ce22-4ffd-b5a0-f44a21399308", "bridge": "br-int", "label": "tempest-device-tagging-net2-639540845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf002d56c-77", "ovs_interfaceid": "f002d56c-77f0-4fb0-9501-751106b08f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:55.068775 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Successfully updated port: a7d7f523-bf9e-4f8f-881d-9d05c514eb54 {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:42:55.083625 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-5ffb7162-0ad0-4e24-80d6-770da2675e54 req-32d3742a-9273-4942-b4fb-06f6a010777c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:55.098865 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-12de2840-d4f7-4ede-b748-995ab7a4a73d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 6.033s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:55.147759 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-9bccda39-b36f-4510-9fc5-dc1b5c0c2162 req-6d72b610-bba8-4f62-9bc2-cd06119d1d21 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-changed-a7d7f523-bf9e-4f8f-881d-9d05c514eb54 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:55.147759 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-9bccda39-b36f-4510-9fc5-dc1b5c0c2162 req-6d72b610-bba8-4f62-9bc2-cd06119d1d21 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Refreshing instance network info cache due to event network-changed-a7d7f523-bf9e-4f8f-881d-9d05c514eb54. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:42:55.147928 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-9bccda39-b36f-4510-9fc5-dc1b5c0c2162 req-6d72b610-bba8-4f62-9bc2-cd06119d1d21 service nova] Acquiring lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:55.202593 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-5ffb7162-0ad0-4e24-80d6-770da2675e54 req-32d3742a-9273-4942-b4fb-06f6a010777c service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:42:55.475199 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-5ffb7162-0ad0-4e24-80d6-770da2675e54 req-32d3742a-9273-4942-b4fb-06f6a010777c service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:55.523090 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-f5abd135-dc76-4c95-b37d-703d45d3d5ec req-37c9b72e-db66-4941-93d4-754d94e40ee5 service nova] Releasing lock "refresh_cache-9c033870-f167-4235-86ff-98005452a16c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:42:55.966252 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "19180a23-a7e0-4354-b9f4-9ca57062fc06" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:55.966404 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "19180a23-a7e0-4354-b9f4-9ca57062fc06" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:55.980367 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-5ffb7162-0ad0-4e24-80d6-770da2675e54 req-32d3742a-9273-4942-b4fb-06f6a010777c service nova] Releasing lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:42:55.980886 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-9bccda39-b36f-4510-9fc5-dc1b5c0c2162 req-6d72b610-bba8-4f62-9bc2-cd06119d1d21 service nova] Acquired lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:42:55.981090 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-9bccda39-b36f-4510-9fc5-dc1b5c0c2162 req-6d72b610-bba8-4f62-9bc2-cd06119d1d21 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Refreshing network info cache for port a7d7f523-bf9e-4f8f-881d-9d05c514eb54 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:42:56.308619 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Successfully updated port: ed1393f8-f25b-489d-9635-82b920d33137 {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:42:56.470541 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Detaching volume 9ed8d9ce-b06c-4856-91a6-090a64fd59c4 Jun 25 04:42:56.484863 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-9bccda39-b36f-4510-9fc5-dc1b5c0c2162 req-6d72b610-bba8-4f62-9bc2-cd06119d1d21 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:56.526256 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-a3e63543-1b68-488c-860f-b3753f098866 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5/disk --force-share --output=json -f qcow2 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:56.546181 np0000003587 nova-compute[98952]: INFO nova.virt.block_device [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Attempting to driver detach volume 9ed8d9ce-b06c-4856-91a6-090a64fd59c4 from mountpoint /dev/vdb Jun 25 04:42:56.559380 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Found disk vdb by alias ua-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 {{(pid=98952) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 25 04:42:56.563435 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Found disk vdb by alias ua-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 {{(pid=98952) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 25 04:42:56.563609 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Attempting to detach device vdb from instance 19180a23-a7e0-4354-b9f4-9ca57062fc06 from the persistent domain config. {{(pid=98952) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 25 04:42:56.563965 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] detach device xml: Jun 25 04:42:56.563965 np0000003587 nova-compute[98952]: Jun 25 04:42:56.563965 np0000003587 nova-compute[98952]: Jun 25 04:42:56.563965 np0000003587 nova-compute[98952]: Jun 25 04:42:56.563965 np0000003587 nova-compute[98952]: Jun 25 04:42:56.563965 np0000003587 nova-compute[98952]: 9ed8d9ce-b06c-4856-91a6-090a64fd59c4 Jun 25 04:42:56.563965 np0000003587 nova-compute[98952]: Jun 25 04:42:56.563965 np0000003587 nova-compute[98952]:
Jun 25 04:42:56.563965 np0000003587 nova-compute[98952]: Jun 25 04:42:56.563965 np0000003587 nova-compute[98952]: {{(pid=98952) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 25 04:42:56.568973 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-90ad1b19-74ca-4d36-ab82-1377590e0ba0 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Acquiring lock "775ef107-e7ca-4d94-b5ab-2ec8665a4906" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:56.569814 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-90ad1b19-74ca-4d36-ab82-1377590e0ba0 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "775ef107-e7ca-4d94-b5ab-2ec8665a4906" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:56.571157 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-90ad1b19-74ca-4d36-ab82-1377590e0ba0 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Acquiring lock "775ef107-e7ca-4d94-b5ab-2ec8665a4906-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:56.571157 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-90ad1b19-74ca-4d36-ab82-1377590e0ba0 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "775ef107-e7ca-4d94-b5ab-2ec8665a4906-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:56.571157 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-90ad1b19-74ca-4d36-ab82-1377590e0ba0 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "775ef107-e7ca-4d94-b5ab-2ec8665a4906-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:56.575595 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-90ad1b19-74ca-4d36-ab82-1377590e0ba0 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Terminating instance Jun 25 04:42:56.584895 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Successfully detached device vdb from instance 19180a23-a7e0-4354-b9f4-9ca57062fc06 from the persistent domain config. Jun 25 04:42:56.585292 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] (1/8): Attempting to detach device vdb with device alias ua-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 from instance 19180a23-a7e0-4354-b9f4-9ca57062fc06 from the live domain config. {{(pid=98952) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 25 04:42:56.585498 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] detach device xml: Jun 25 04:42:56.585498 np0000003587 nova-compute[98952]: Jun 25 04:42:56.585498 np0000003587 nova-compute[98952]: Jun 25 04:42:56.585498 np0000003587 nova-compute[98952]: Jun 25 04:42:56.585498 np0000003587 nova-compute[98952]: Jun 25 04:42:56.585498 np0000003587 nova-compute[98952]: 9ed8d9ce-b06c-4856-91a6-090a64fd59c4 Jun 25 04:42:56.585498 np0000003587 nova-compute[98952]: Jun 25 04:42:56.585498 np0000003587 nova-compute[98952]:
Jun 25 04:42:56.585498 np0000003587 nova-compute[98952]: Jun 25 04:42:56.585498 np0000003587 nova-compute[98952]: {{(pid=98952) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 25 04:42:56.600920 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-9bccda39-b36f-4510-9fc5-dc1b5c0c2162 req-6d72b610-bba8-4f62-9bc2-cd06119d1d21 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:42:56.631393 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-a3e63543-1b68-488c-860f-b3753f098866 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5/disk --force-share --output=json -f qcow2" returned: 0 in 0.105s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:56.631985 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-a3e63543-1b68-488c-860f-b3753f098866 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5/disk --force-share --output=json -f qcow2 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:56.734479 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-a3e63543-1b68-488c-860f-b3753f098866 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5/disk --force-share --output=json -f qcow2" returned: 0 in 0.102s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:56.737048 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-a3e63543-1b68-488c-860f-b3753f098866 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:42:56.743549 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-a3e63543-1b68-488c-860f-b3753f098866 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:42:56.744203 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-a3e63543-1b68-488c-860f-b3753f098866 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:56.838273 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-9bccda39-b36f-4510-9fc5-dc1b5c0c2162 req-6d72b610-bba8-4f62-9bc2-cd06119d1d21 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:56.845289 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-a3e63543-1b68-488c-860f-b3753f098866 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.101s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:56.846781 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-a3e63543-1b68-488c-860f-b3753f098866 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwz_md5w6/162ba81441c5415caf98cb8a2cac8110.delta 1073741824 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:56.899978 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-a3e63543-1b68-488c-860f-b3753f098866 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwz_md5w6/162ba81441c5415caf98cb8a2cac8110.delta 1073741824" returned: 0 in 0.054s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:56.901146 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-a3e63543-1b68-488c-860f-b3753f098866 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Quiescing instance not available: QEMU guest agent is not enabled. Jun 25 04:42:57.085159 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-90ad1b19-74ca-4d36-ab82-1377590e0ba0 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Start destroying the instance on the hypervisor. {{(pid=98952) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 25 04:42:57.120215 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:57.132903 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:57.150075 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:57.166720 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:57.200120 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:57.258219 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-a3e63543-1b68-488c-860f-b3753f098866 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98952) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jun 25 04:42:57.265942 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-a3e63543-1b68-488c-860f-b3753f098866 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Skipping quiescing instance: QEMU guest agent is not enabled. Jun 25 04:42:57.271053 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-f5947860-0368-4937-859a-b32b862d1b2a req-258b9c0a-8137-43e9-922c-5505b48f73b0 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-changed-ed1393f8-f25b-489d-9635-82b920d33137 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:57.271316 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-f5947860-0368-4937-859a-b32b862d1b2a req-258b9c0a-8137-43e9-922c-5505b48f73b0 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Refreshing instance network info cache due to event network-changed-ed1393f8-f25b-489d-9635-82b920d33137. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:42:57.271516 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-f5947860-0368-4937-859a-b32b862d1b2a req-258b9c0a-8137-43e9-922c-5505b48f73b0 service nova] Acquiring lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:57.334059 np0000003587 nova-compute[98952]: DEBUG nova.privsep.utils [None req-a3e63543-1b68-488c-860f-b3753f098866 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98952) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 25 04:42:57.334426 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-a3e63543-1b68-488c-860f-b3753f098866 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwz_md5w6/162ba81441c5415caf98cb8a2cac8110.delta /opt/stack/data/nova/instances/snapshots/tmpwz_md5w6/162ba81441c5415caf98cb8a2cac8110 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:42:57.350583 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-9bccda39-b36f-4510-9fc5-dc1b5c0c2162 req-6d72b610-bba8-4f62-9bc2-cd06119d1d21 service nova] Releasing lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:42:57.352953 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-f5947860-0368-4937-859a-b32b862d1b2a req-258b9c0a-8137-43e9-922c-5505b48f73b0 service nova] Acquired lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:42:57.352953 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-f5947860-0368-4937-859a-b32b862d1b2a req-258b9c0a-8137-43e9-922c-5505b48f73b0 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Refreshing network info cache for port ed1393f8-f25b-489d-9635-82b920d33137 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:42:57.393724 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6c2078bb-a90e-4cdd-881c-97d754f59ef0 req-9a93cf7c-ef6b-47c2-a49a-b4af99e03605 service nova] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Received event network-vif-unplugged-93cdbb39-15d6-4bb1-a55a-bccc139ac288 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:57.393972 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6c2078bb-a90e-4cdd-881c-97d754f59ef0 req-9a93cf7c-ef6b-47c2-a49a-b4af99e03605 service nova] Acquiring lock "775ef107-e7ca-4d94-b5ab-2ec8665a4906-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:57.394162 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6c2078bb-a90e-4cdd-881c-97d754f59ef0 req-9a93cf7c-ef6b-47c2-a49a-b4af99e03605 service nova] Lock "775ef107-e7ca-4d94-b5ab-2ec8665a4906-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:57.394887 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6c2078bb-a90e-4cdd-881c-97d754f59ef0 req-9a93cf7c-ef6b-47c2-a49a-b4af99e03605 service nova] Lock "775ef107-e7ca-4d94-b5ab-2ec8665a4906-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:57.395026 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6c2078bb-a90e-4cdd-881c-97d754f59ef0 req-9a93cf7c-ef6b-47c2-a49a-b4af99e03605 service nova] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] No waiting events found dispatching network-vif-unplugged-93cdbb39-15d6-4bb1-a55a-bccc139ac288 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:42:57.395156 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6c2078bb-a90e-4cdd-881c-97d754f59ef0 req-9a93cf7c-ef6b-47c2-a49a-b4af99e03605 service nova] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Received event network-vif-unplugged-93cdbb39-15d6-4bb1-a55a-bccc139ac288 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:42:57.483138 np0000003587 nova-compute[98952]: DEBUG nova.utils [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Queued Task(fn=>, remaining_delay=14.99954773100012 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:42:57.493600 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Instance destroyed successfully. Jun 25 04:42:57.496778 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-90ad1b19-74ca-4d36-ab82-1377590e0ba0 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lazy-loading 'resources' on Instance uuid 775ef107-e7ca-4d94-b5ab-2ec8665a4906 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:42:57.577851 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-a3e63543-1b68-488c-860f-b3753f098866 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwz_md5w6/162ba81441c5415caf98cb8a2cac8110.delta /opt/stack/data/nova/instances/snapshots/tmpwz_md5w6/162ba81441c5415caf98cb8a2cac8110" returned: 0 in 0.243s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:42:57.579242 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-a3e63543-1b68-488c-860f-b3753f098866 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Snapshot extracted, beginning image upload Jun 25 04:42:57.862461 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Successfully updated port: 2af2f66c-7de8-49e4-badd-16d0764caff6 {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:42:57.863622 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-f5947860-0368-4937-859a-b32b862d1b2a req-258b9c0a-8137-43e9-922c-5505b48f73b0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:57.903972 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0015003370001522853 future=) submitted to {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:42:57.905735 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:42:57.905735 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.57711831100005 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:42:57.905735 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.576981196000133 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:42:57.905735 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:42:57.906271 np0000003587 nova-compute[98952]: INFO nova.compute.manager [-] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] VM Stopped (Lifecycle Event) Jun 25 04:42:57.944415 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-9a816412-d176-4196-a763-427686154dc9 req-f0fcad1c-079c-4ad9-86f6-1e7a52f8ce95 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-changed-2af2f66c-7de8-49e4-badd-16d0764caff6 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:57.944689 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-9a816412-d176-4196-a763-427686154dc9 req-f0fcad1c-079c-4ad9-86f6-1e7a52f8ce95 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Refreshing instance network info cache due to event network-changed-2af2f66c-7de8-49e4-badd-16d0764caff6. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:42:57.944857 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-9a816412-d176-4196-a763-427686154dc9 req-f0fcad1c-079c-4ad9-86f6-1e7a52f8ce95 service nova] Acquiring lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:57.972097 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-f5947860-0368-4937-859a-b32b862d1b2a req-258b9c0a-8137-43e9-922c-5505b48f73b0 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:42:57.998592 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-90ad1b19-74ca-4d36-ab82-1377590e0ba0 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1193770806',display_name='tempest-VolumesActionsTest-instance-1193770806',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-volumesactionstest-instance-1193770806',id=11,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-25T04:42:53Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='00cdd814e374462e9477baf02d6c2fdb',ramdisk_id='',reservation_id='r-itvpglhh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-93709413',owner_user_name='tempest-VolumesActionsTest-93709413-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:42:54Z,user_data=None,user_id='7f9bd46f11cd4d38bbf9926be137ca8e',uuid=775ef107-e7ca-4d94-b5ab-2ec8665a4906,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93cdbb39-15d6-4bb1-a55a-bccc139ac288", "address": "fa:16:3e:07:f4:ac", "network": {"id": "d59f1de2-a0fd-4318-9724-66a1bbe8ec86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-557005970-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "00cdd814e374462e9477baf02d6c2fdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93cdbb39-15", "ovs_interfaceid": "93cdbb39-15d6-4bb1-a55a-bccc139ac288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:42:57.999912 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-90ad1b19-74ca-4d36-ab82-1377590e0ba0 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Converting VIF {"id": "93cdbb39-15d6-4bb1-a55a-bccc139ac288", "address": "fa:16:3e:07:f4:ac", "network": {"id": "d59f1de2-a0fd-4318-9724-66a1bbe8ec86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-557005970-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "00cdd814e374462e9477baf02d6c2fdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93cdbb39-15", "ovs_interfaceid": "93cdbb39-15d6-4bb1-a55a-bccc139ac288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:42:57.999912 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-90ad1b19-74ca-4d36-ab82-1377590e0ba0 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:f4:ac,bridge_name='br-int',has_traffic_filtering=True,id=93cdbb39-15d6-4bb1-a55a-bccc139ac288,network=Network(d59f1de2-a0fd-4318-9724-66a1bbe8ec86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93cdbb39-15') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:42:57.999912 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-90ad1b19-74ca-4d36-ab82-1377590e0ba0 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:f4:ac,bridge_name='br-int',has_traffic_filtering=True,id=93cdbb39-15d6-4bb1-a55a-bccc139ac288,network=Network(d59f1de2-a0fd-4318-9724-66a1bbe8ec86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93cdbb39-15') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:42:58.001691 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:58.002065 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93cdbb39-15, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:58.003591 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:58.004404 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:58.061915 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:58.063479 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:58.063790 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eae62767-bddb-46fd-b829-73a6ef42d823) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:42:58.064959 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:58.065667 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:42:58.067751 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:58.074651 np0000003587 nova-compute[98952]: INFO os_vif [None req-90ad1b19-74ca-4d36-ab82-1377590e0ba0 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:f4:ac,bridge_name='br-int',has_traffic_filtering=True,id=93cdbb39-15d6-4bb1-a55a-bccc139ac288,network=Network(d59f1de2-a0fd-4318-9724-66a1bbe8ec86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93cdbb39-15') Jun 25 04:42:58.074998 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-90ad1b19-74ca-4d36-ab82-1377590e0ba0 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Deleting instance files /opt/stack/data/nova/instances/775ef107-e7ca-4d94-b5ab-2ec8665a4906_del Jun 25 04:42:58.076389 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-90ad1b19-74ca-4d36-ab82-1377590e0ba0 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Deletion of /opt/stack/data/nova/instances/775ef107-e7ca-4d94-b5ab-2ec8665a4906_del complete Jun 25 04:42:58.198530 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-f5947860-0368-4937-859a-b32b862d1b2a req-258b9c0a-8137-43e9-922c-5505b48f73b0 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:58.292219 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:42:58.388739 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98952) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 25 04:42:58.409164 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-3c776674-51b9-451f-9c91-79b5e671d096 None None] [instance: 54721bc9-c45c-4cb1-9910-f47334e84cd2] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:42:58.587226 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-90ad1b19-74ca-4d36-ab82-1377590e0ba0 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Took 1.50 seconds to destroy the instance on the hypervisor. Jun 25 04:42:58.591541 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._common.loopingcall [None req-90ad1b19-74ca-4d36-ab82-1377590e0ba0 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98952) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 25 04:42:58.593660 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [-] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Deallocating network for instance {{(pid=98952) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 25 04:42:58.593660 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] deallocate_for_instance() {{(pid=98952) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 25 04:42:58.594607 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:58.686624 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:58.700629 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-f5947860-0368-4937-859a-b32b862d1b2a req-258b9c0a-8137-43e9-922c-5505b48f73b0 service nova] Releasing lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:42:58.701778 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-9a816412-d176-4196-a763-427686154dc9 req-f0fcad1c-079c-4ad9-86f6-1e7a52f8ce95 service nova] Acquired lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:42:58.702077 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-9a816412-d176-4196-a763-427686154dc9 req-f0fcad1c-079c-4ad9-86f6-1e7a52f8ce95 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Refreshing network info cache for port 2af2f66c-7de8-49e4-badd-16d0764caff6 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:42:59.048296 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Received event ua-9ed8d9ce-b06c-4856-91a6-090a64fd59c4> from libvirt while the driver is waiting for it; dispatched. {{(pid=98952) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 25 04:42:59.054290 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 for instance 19180a23-a7e0-4354-b9f4-9ca57062fc06 {{(pid=98952) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 25 04:42:59.061840 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Successfully detached device vdb from instance 19180a23-a7e0-4354-b9f4-9ca57062fc06 from the live domain config. Jun 25 04:42:59.131967 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] calling os-brick to detach iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 25 04:42:59.132226 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:42:59.132226 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:42:59.132788 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:42:59.137341 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 25 04:42:59.138542 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4', 0)] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 25 04:42:59.185595 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:59.185595 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:59.185595 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:59.185595 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:59.185595 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:59.185595 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:59.185595 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:42:59.185595 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:42:59.185595 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:59.185595 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:59.185595 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:59.185595 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:59.185595 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:42:59.186081 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:59.186081 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:42:59.186081 np0000003587 nova-compute[98952]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:59.186081 np0000003587 nova-compute[98952]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4 (non-flash) Jun 25 04:42:59.186081 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:59.186081 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:42:59.186081 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:42:59.186081 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:42:59.186081 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:59.186081 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:42:59.186081 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:59.186081 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:42:59.186081 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:42:59.186081 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', '15'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', '6')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 25 04:42:59.186496 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4', '14')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:42:59.187597 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4', '13')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:42:59.189421 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Resulting device map defaultdict(. at 0x7a16b97398a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4'): ({'sdl'}, set())}) {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 25 04:42:59.189954 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Removing multipathed devices sdm, sdl {{(pid=98952) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 25 04:42:59.190301 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Flush multipath device 330000000f79aaea1 {{(pid=98952) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 25 04:42:59.208183 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-9a816412-d176-4196-a763-427686154dc9 req-f0fcad1c-079c-4ad9-86f6-1e7a52f8ce95 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:42:59.235314 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:42:59.290129 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:42:59.314547 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Successfully updated port: 07a46cd4-912b-4863-8b8f-f345fe260bd0 {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:42:59.319246 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-9a816412-d176-4196-a763-427686154dc9 req-f0fcad1c-079c-4ad9-86f6-1e7a52f8ce95 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:42:59.343530 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 25 04:42:59.343767 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 25 04:42:59.345588 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 25 04:42:59.364754 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 25 04:42:59.369976 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4')] {{(pid=98952) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 25 04:42:59.385105 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:59.412731 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-3a4610b2-6c10-4e12-b636-b6473a2bc952 req-339aa50e-0886-4544-a695-d6dc2e24c85d service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-changed-07a46cd4-912b-4863-8b8f-f345fe260bd0 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:59.414189 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-3a4610b2-6c10-4e12-b636-b6473a2bc952 req-339aa50e-0886-4544-a695-d6dc2e24c85d service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Refreshing instance network info cache due to event network-changed-07a46cd4-912b-4863-8b8f-f345fe260bd0. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:42:59.414189 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-3a4610b2-6c10-4e12-b636-b6473a2bc952 req-339aa50e-0886-4544-a695-d6dc2e24c85d service nova] Acquiring lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:59.436610 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4, portal: 192.168.40.100,3260] Jun 25 04:42:59.436610 np0000003587 nova-compute[98952]: Logout of [sid: 14, target: iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4, portal: 192.168.40.100,3260] successful. Jun 25 04:42:59.436610 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:59.462421 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:59.477190 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:59.495191 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d4e7727a-4503-4bf9-b35d-95bd8d550c4d req-2a67bafb-347e-41c2-8c6f-5fde0d91c882 service nova] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Received event network-vif-unplugged-93cdbb39-15d6-4bb1-a55a-bccc139ac288 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:59.495422 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d4e7727a-4503-4bf9-b35d-95bd8d550c4d req-2a67bafb-347e-41c2-8c6f-5fde0d91c882 service nova] Acquiring lock "775ef107-e7ca-4d94-b5ab-2ec8665a4906-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:42:59.495673 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d4e7727a-4503-4bf9-b35d-95bd8d550c4d req-2a67bafb-347e-41c2-8c6f-5fde0d91c882 service nova] Lock "775ef107-e7ca-4d94-b5ab-2ec8665a4906-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:42:59.496677 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d4e7727a-4503-4bf9-b35d-95bd8d550c4d req-2a67bafb-347e-41c2-8c6f-5fde0d91c882 service nova] Lock "775ef107-e7ca-4d94-b5ab-2ec8665a4906-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:42:59.496677 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d4e7727a-4503-4bf9-b35d-95bd8d550c4d req-2a67bafb-347e-41c2-8c6f-5fde0d91c882 service nova] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] No waiting events found dispatching network-vif-unplugged-93cdbb39-15d6-4bb1-a55a-bccc139ac288 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:42:59.496773 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d4e7727a-4503-4bf9-b35d-95bd8d550c4d req-2a67bafb-347e-41c2-8c6f-5fde0d91c882 service nova] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Received event network-vif-unplugged-93cdbb39-15d6-4bb1-a55a-bccc139ac288 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:42:59.497454 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d4e7727a-4503-4bf9-b35d-95bd8d550c4d req-2a67bafb-347e-41c2-8c6f-5fde0d91c882 service nova] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Received event network-vif-deleted-93cdbb39-15d6-4bb1-a55a-bccc139ac288 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:42:59.497454 np0000003587 nova-compute[98952]: INFO nova.compute.manager [req-d4e7727a-4503-4bf9-b35d-95bd8d550c4d req-2a67bafb-347e-41c2-8c6f-5fde0d91c882 service nova] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Neutron deleted interface 93cdbb39-15d6-4bb1-a55a-bccc139ac288; detaching it from the instance and deleting it from the info cache Jun 25 04:42:59.499657 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d4e7727a-4503-4bf9-b35d-95bd8d550c4d req-2a67bafb-347e-41c2-8c6f-5fde0d91c882 service nova] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Detach interface failed, port_id=93cdbb39-15d6-4bb1-a55a-bccc139ac288, reason: Instance 775ef107-e7ca-4d94-b5ab-2ec8665a4906 could not be found. {{(pid=98952) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 25 04:42:59.520854 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4, portal: 192.168.50.100,3260] Jun 25 04:42:59.520854 np0000003587 nova-compute[98952]: Logout of [sid: 13, target: iqn.2023-03.storpool.com:os--volume-9ed8d9ce-b06c-4856-91a6-090a64fd59c4, portal: 192.168.50.100,3260] successful. Jun 25 04:42:59.520854 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:59.545316 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:42:59.545612 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:42:59.545699 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] <== disconnect_volume: return (412ms) None {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:42:59.545789 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Disconnected iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 25 04:42:59.552072 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-9a816412-d176-4196-a763-427686154dc9 req-f0fcad1c-079c-4ad9-86f6-1e7a52f8ce95 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:59.606151 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:42:59.818799 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquiring lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:42:59.868521 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:00.054394 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-9a816412-d176-4196-a763-427686154dc9 req-f0fcad1c-079c-4ad9-86f6-1e7a52f8ce95 service nova] Releasing lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:43:00.056171 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-3a4610b2-6c10-4e12-b636-b6473a2bc952 req-339aa50e-0886-4544-a695-d6dc2e24c85d service nova] Acquired lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:43:00.056406 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-3a4610b2-6c10-4e12-b636-b6473a2bc952 req-339aa50e-0886-4544-a695-d6dc2e24c85d service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Refreshing network info cache for port 07a46cd4-912b-4863-8b8f-f345fe260bd0 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:43:00.108415 np0000003587 nova-compute[98952]: INFO nova.compute.manager [-] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Took 1.51 seconds to deallocate network for instance. Jun 25 04:43:00.127908 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lazy-loading 'flavor' on Instance uuid 19180a23-a7e0-4354-b9f4-9ca57062fc06 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:43:00.561382 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-3a4610b2-6c10-4e12-b636-b6473a2bc952 req-339aa50e-0886-4544-a695-d6dc2e24c85d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:00.621396 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-90ad1b19-74ca-4d36-ab82-1377590e0ba0 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:00.621915 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-90ad1b19-74ca-4d36-ab82-1377590e0ba0 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:00.682862 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-3a4610b2-6c10-4e12-b636-b6473a2bc952 req-339aa50e-0886-4544-a695-d6dc2e24c85d service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:43:00.802798 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:00.921006 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-3a4610b2-6c10-4e12-b636-b6473a2bc952 req-339aa50e-0886-4544-a695-d6dc2e24c85d service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:01.140834 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ad385fb5-7dae-4a53-98c0-617d32455b82 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "19180a23-a7e0-4354-b9f4-9ca57062fc06" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 5.174s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:01.308836 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-90ad1b19-74ca-4d36-ab82-1377590e0ba0 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:43:01.309074 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-90ad1b19-74ca-4d36-ab82-1377590e0ba0 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:43:01.422792 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-3a4610b2-6c10-4e12-b636-b6473a2bc952 req-339aa50e-0886-4544-a695-d6dc2e24c85d service nova] Releasing lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:43:01.423567 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquired lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:43:01.423729 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:43:01.492508 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-a3e63543-1b68-488c-860f-b3753f098866 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Snapshot image upload complete Jun 25 04:43:01.492508 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-a3e63543-1b68-488c-860f-b3753f098866 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Took 6.64 seconds to snapshot the instance on the hypervisor. Jun 25 04:43:01.812277 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-90ad1b19-74ca-4d36-ab82-1377590e0ba0 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:43:02.035933 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:43:02.247896 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:02.323336 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-90ad1b19-74ca-4d36-ab82-1377590e0ba0 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.702s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:02.404867 np0000003587 nova-compute[98952]: INFO nova.scheduler.client.report [None req-90ad1b19-74ca-4d36-ab82-1377590e0ba0 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Deleted allocations for instance 775ef107-e7ca-4d94-b5ab-2ec8665a4906 Jun 25 04:43:02.675714 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:02.935991 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "ea0f9737-865a-4199-9077-b64e88af15db" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:02.935991 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "ea0f9737-865a-4199-9077-b64e88af15db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:03.065160 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:03.078850 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:03.415138 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-90ad1b19-74ca-4d36-ab82-1377590e0ba0 tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "775ef107-e7ca-4d94-b5ab-2ec8665a4906" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.846s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:03.436487 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:43:03.483982 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:03.874542 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "df96228c-c3b2-457d-9eb1-2e82186076f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:03.874717 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:03.969820 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:04.019424 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:04.019580 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:04.024260 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:43:04.024405 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Claim successful on node np0000003587 Jun 25 04:43:04.377100 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:43:04.383632 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:04.804717 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:04.871911 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:04.962685 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:05.023268 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Updating instance_info_cache with network_info: [{"id": "22fd01da-9056-4cd0-8489-c9f005bb66a5", "address": "fa:16:3e:cc:30:bf", "network": {"id": "e2c0ccd0-a308-4fd9-8b43-472d9a2acb3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-814024004-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22fd01da-90", "ovs_interfaceid": "22fd01da-9056-4cd0-8489-c9f005bb66a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a36eb1f7-4779-4078-a224-bc487abd01a6", "address": "fa:16:3e:aa:4f:74", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36eb1f7-47", "ovs_interfaceid": "a36eb1f7-4779-4078-a224-bc487abd01a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff5a5c31-e634-489a-b565-418e87aaa11b", "address": "fa:16:3e:42:3a:ef", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5a5c31-e6", "ovs_interfaceid": "ff5a5c31-e634-489a-b565-418e87aaa11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7d7f523-bf9e-4f8f-881d-9d05c514eb54", "address": "fa:16:3e:e8:ba:ea", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d7f523-bf", "ovs_interfaceid": "a7d7f523-bf9e-4f8f-881d-9d05c514eb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed1393f8-f25b-489d-9635-82b920d33137", "address": "fa:16:3e:a7:57:df", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped1393f8-f2", "ovs_interfaceid": "ed1393f8-f25b-489d-9635-82b920d33137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2af2f66c-7de8-49e4-badd-16d0764caff6", "address": "fa:16:3e:fa:99:7d", "network": {"id": "dbbc0276-7726-40fd-b3ee-f5a7887f5e72", "bridge": "br-int", "label": "tempest-device-tagging-net2-1967790487", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af2f66c-7d", "ovs_interfaceid": "2af2f66c-7de8-49e4-badd-16d0764caff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07a46cd4-912b-4863-8b8f-f345fe260bd0", "address": "fa:16:3e:95:90:8b", "network": {"id": "dbbc0276-7726-40fd-b3ee-f5a7887f5e72", "bridge": "br-int", "label": "tempest-device-tagging-net2-1967790487", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a46cd4-91", "ovs_interfaceid": "07a46cd4-912b-4863-8b8f-f345fe260bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:05.363286 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Acquiring lock "7671d823-fb04-46c9-80d9-e171d8032199" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:05.364069 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "7671d823-fb04-46c9-80d9-e171d8032199" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:05.528142 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Releasing lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:43:05.528714 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Instance network_info: |[{"id": "22fd01da-9056-4cd0-8489-c9f005bb66a5", "address": "fa:16:3e:cc:30:bf", "network": {"id": "e2c0ccd0-a308-4fd9-8b43-472d9a2acb3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-814024004-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22fd01da-90", "ovs_interfaceid": "22fd01da-9056-4cd0-8489-c9f005bb66a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a36eb1f7-4779-4078-a224-bc487abd01a6", "address": "fa:16:3e:aa:4f:74", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36eb1f7-47", "ovs_interfaceid": "a36eb1f7-4779-4078-a224-bc487abd01a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff5a5c31-e634-489a-b565-418e87aaa11b", "address": "fa:16:3e:42:3a:ef", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5a5c31-e6", "ovs_interfaceid": "ff5a5c31-e634-489a-b565-418e87aaa11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7d7f523-bf9e-4f8f-881d-9d05c514eb54", "address": "fa:16:3e:e8:ba:ea", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d7f523-bf", "ovs_interfaceid": "a7d7f523-bf9e-4f8f-881d-9d05c514eb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed1393f8-f25b-489d-9635-82b920d33137", "address": "fa:16:3e:a7:57:df", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped1393f8-f2", "ovs_interfaceid": "ed1393f8-f25b-489d-9635-82b920d33137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2af2f66c-7de8-49e4-badd-16d0764caff6", "address": "fa:16:3e:fa:99:7d", "network": {"id": "dbbc0276-7726-40fd-b3ee-f5a7887f5e72", "bridge": "br-int", "label": "tempest-device-tagging-net2-1967790487", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af2f66c-7d", "ovs_interfaceid": "2af2f66c-7de8-49e4-badd-16d0764caff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07a46cd4-912b-4863-8b8f-f345fe260bd0", "address": "fa:16:3e:95:90:8b", "network": {"id": "dbbc0276-7726-40fd-b3ee-f5a7887f5e72", "bridge": "br-int", "label": "tempest-device-tagging-net2-1967790487", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a46cd4-91", "ovs_interfaceid": "07a46cd4-912b-4863-8b8f-f345fe260bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 25 04:43:05.531134 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Start _get_guest_xml network_info=[{"id": "22fd01da-9056-4cd0-8489-c9f005bb66a5", "address": "fa:16:3e:cc:30:bf", "network": {"id": "e2c0ccd0-a308-4fd9-8b43-472d9a2acb3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-814024004-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22fd01da-90", "ovs_interfaceid": "22fd01da-9056-4cd0-8489-c9f005bb66a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a36eb1f7-4779-4078-a224-bc487abd01a6", "address": "fa:16:3e:aa:4f:74", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36eb1f7-47", "ovs_interfaceid": "a36eb1f7-4779-4078-a224-bc487abd01a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff5a5c31-e634-489a-b565-418e87aaa11b", "address": "fa:16:3e:42:3a:ef", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5a5c31-e6", "ovs_interfaceid": "ff5a5c31-e634-489a-b565-418e87aaa11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7d7f523-bf9e-4f8f-881d-9d05c514eb54", "address": "fa:16:3e:e8:ba:ea", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d7f523-bf", "ovs_interfaceid": "a7d7f523-bf9e-4f8f-881d-9d05c514eb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed1393f8-f25b-489d-9635-82b920d33137", "address": "fa:16:3e:a7:57:df", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped1393f8-f2", "ovs_interfaceid": "ed1393f8-f25b-489d-9635-82b920d33137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2af2f66c-7de8-49e4-badd-16d0764caff6", "address": "fa:16:3e:fa:99:7d", "network": {"id": "dbbc0276-7726-40fd-b3ee-f5a7887f5e72", "bridge": "br-int", "label": "tempest-device-tagging-net2-1967790487", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af2f66c-7d", "ovs_interfaceid": "2af2f66c-7de8-49e4-badd-16d0764caff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07a46cd4-912b-4863-8b8f-f345fe260bd0", "address": "fa:16:3e:95:90:8b", "network": {"id": "dbbc0276-7726-40fd-b3ee-f5a7887f5e72", "bridge": "br-int", "label": "tempest-device-tagging-net2-1967790487", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a46cd4-91", "ovs_interfaceid": "07a46cd4-912b-4863-8b8f-f345fe260bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '94315545-1fac-434f-9971-01dd561f2296', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '25ee71dc-21c1-4ed4-b3d4-7f8cc107a863', 'attached_at': '', 'detached_at': '', 'volume_id': '94315545-1fac-434f-9971-01dd561f2296', 'serial': '94315545-1fac-434f-9971-01dd561f2296'}, 'attachment_id': 'eb426105-361d-467b-9d30-287b6a8952c6', 'device_type': 'disk', 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': 1, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a08f66b0-7f9c-47e4-9418-275768fa9e0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '25ee71dc-21c1-4ed4-b3d4-7f8cc107a863', 'attached_at': '', 'detached_at': '', 'volume_id': 'a08f66b0-7f9c-47e4-9418-275768fa9e0e', 'serial': 'a08f66b0-7f9c-47e4-9418-275768fa9e0e'}, 'attachment_id': 'e00e5819-36b1-4e03-8783-d7cb0fc9f7d7', 'device_type': 'disk', 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'boot_index': 2, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '25ee71dc-21c1-4ed4-b3d4-7f8cc107a863', 'attached_at': '', 'detached_at': '', 'volume_id': '88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', 'serial': '88ff7c97-e5b7-4aaf-8529-ad10c2b94af9'}, 'attachment_id': 'f9dc2e30-00c6-402a-8a5f-924cd8e207ae', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:43:05.538574 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:43:05.539923 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-537495923', uuid='25ee71dc-21c1-4ed4-b3d4-7f8cc107a863'), owner=OwnerMeta(userid='e73054ab2cbd425cb182705f0ebfb7a5', username='tempest-TaggedBootDevicesTest-2097804610-project-member', projectid='40a42527a8b24135b741fe2c38dc14b0', projectname='tempest-TaggedBootDevicesTest-2097804610'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "22fd01da-9056-4cd0-8489-c9f005bb66a5", "address": "fa:16:3e:cc:30:bf", "network": {"id": "e2c0ccd0-a308-4fd9-8b43-472d9a2acb3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-814024004-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22fd01da-90", "ovs_interfaceid": "22fd01da-9056-4cd0-8489-c9f005bb66a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a36eb1f7-4779-4078-a224-bc487abd01a6", "address": "fa:16:3e:aa:4f:74", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36eb1f7-47", "ovs_interfaceid": "a36eb1f7-4779-4078-a224-bc487abd01a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff5a5c31-e634-489a-b565-418e87aaa11b", "address": "fa:16:3e:42:3a:ef", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5a5c31-e6", "ovs_interfaceid": "ff5a5c31-e634-489a-b565-418e87aaa11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7d7f523-bf9e-4f8f-881d-9d05c514eb54", "address": "fa:16:3e:e8:ba:ea", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d7f523-bf", "ovs_interfaceid": "a7d7f523-bf9e-4f8f-881d-9d05c514eb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed1393f8-f25b-489d-9635-82b920d33137", "address": "fa:16:3e:a7:57:df", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped1393f8-f2", "ovs_interfaceid": "ed1393f8-f25b-489d-9635-82b920d33137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2af2f66c-7de8-49e4-badd-16d0764caff6", "address": "fa:16:3e:fa:99:7d", "network": {"id": "dbbc0276-7726-40fd-b3ee-f5a7887f5e72", "bridge": "br-int", "label": "tempest-device-tagging-net2-1967790487", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af2f66c-7d", "ovs_interfaceid": "2af2f66c-7de8-49e4-badd-16d0764caff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07a46cd4-912b-4863-8b8f-f345fe260bd0", "address": "fa:16:3e:95:90:8b", "network": {"id": "dbbc0276-7726-40fd-b3ee-f5a7887f5e72", "bridge": "br-int", "label": "tempest-device-tagging-net2-1967790487", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a46cd4-91", "ovs_interfaceid": "07a46cd4-912b-4863-8b8f-f345fe260bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362585.5393615) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:43:05.541173 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:43:05.541842 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:43:05.544231 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:43:05.544689 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:43:05.545810 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:43:05.546203 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:43:05.546350 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:43:05.546498 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:43:05.546670 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:43:05.546797 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:43:05.546841 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:43:05.546974 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:43:05.547084 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:43:05.547188 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:43:05.547288 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:43:05.547406 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:43:05.562212 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Calling os-brick to attach iSCSI Volume {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 25 04:43:05.562541 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '94315545-1fac-434f-9971-01dd561f2296', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:43:05.562710 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:43:05.563347 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:43:05.563649 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '94315545-1fac-434f-9971-01dd561f2296', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 25 04:43:05.579290 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:43:05.580035 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:43:05.580893 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:43:05.581075 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:43:05.581413 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:43:05.581635 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:43:05.594962 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:43:05.594962 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:05.606226 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:43:05.606226 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:05.612076 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296] added Jun 25 04:43:05.612076 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:43:05.612076 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:43:05.612076 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:43:05.612076 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:43:05.612076 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:43:05.612076 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:05.612391 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:43:05.612473 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0308(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:43:05.612646 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:43:05.619289 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296] added Jun 25 04:43:05.619289 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:43:05.619289 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:43:05.619289 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:43:05.619289 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:43:05.619289 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:43:05.619289 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:05.619533 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:43:05.619754 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0386(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:43:05.619958 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:43:05.777128 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:43:05.777422 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:43:05.866502 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:43:06.222285 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:06.280308 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:43:06.441360 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:06.614615 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:43:06.630147 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.50.100 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:43:06.631761 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.40.100 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:43:06.648585 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:06.653397 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:06.669581 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:06.689940 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:06.689940 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:06.689940 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:06.689940 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:06.689940 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:06.689940 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:06.689940 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:06.689940 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:06.689940 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:06.689940 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:06.689940 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:43:06.689940 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:06.689940 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:06.689940 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:06.689940 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:06.689940 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:06.689940 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:06.689940 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:06.689940 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:06.689940 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:06.689940 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:06.689940 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:43:06.697296 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:06.697296 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:06.697296 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:06.697296 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:06.697296 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:06.697296 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:06.697296 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:06.697296 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:06.697296 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:06.697296 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:06.697296 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:43:06.697296 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:06.697296 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:06.697296 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:06.697296 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:06.697296 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:06.697296 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:06.697296 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:06.697296 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:06.697296 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:06.697296 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:06.697296 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:43:06.757126 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296, portal: 192.168.50.100,3260] Jun 25 04:43:06.757126 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296, portal: 192.168.50.100,3260] successful. Jun 25 04:43:06.757126 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:06.770461 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296, portal: 192.168.40.100,3260] Jun 25 04:43:06.770461 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296, portal: 192.168.40.100,3260] successful. Jun 25 04:43:06.770461 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:06.779538 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:06.789893 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.770s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:06.791421 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:43:06.797210 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:06.797746 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.835s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:06.800862 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:43:06.801023 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Claim successful on node np0000003587 Jun 25 04:43:06.808249 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:06.808249 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:06.808249 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:06.808249 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:06.808249 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:06.808249 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:06.808249 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:06.808249 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:06.808249 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:06.808249 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:06.808249 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:06.808249 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:06.808249 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:43:06.808749 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:06.808749 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:06.808749 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:06.808749 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:06.808749 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:06.808749 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:06.808749 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:06.808749 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:06.808749 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:06.808749 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:06.808749 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:06.808749 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:06.808749 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:43:06.809229 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.228s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:43:06.809229 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Connected to 192.168.50.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:43:06.810513 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] HCTL ('17', '-', '-', 0) found on session 19 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:43:06.810891 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:43:06.825092 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:06.825092 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:06.825092 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:06.825092 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:06.825092 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:06.825092 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:06.825092 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:06.825092 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:06.825092 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:06.825092 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:06.825092 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:06.825092 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:06.825092 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:43:06.825523 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:06.825523 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:06.825523 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:06.825523 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:06.825523 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:06.825523 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:06.825523 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:06.825523 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:06.825523 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:06.825523 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:06.825523 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:06.825523 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:06.825523 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:43:06.825523 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.245s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:43:06.826176 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Connected to 192.168.40.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:43:06.827305 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] HCTL ('18', '-', '-', 0) found on session 20 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:43:06.827305 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:43:06.840671 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Searching for a device in session 19 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:43:06.840911 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '94315545-1fac-434f-9971-01dd561f2296', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:43:06.854328 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Searching for a device in session 20 and hctl ['18', '*', '*', 0] yield: None {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:43:07.299750 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:43:07.300161 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:43:07.300218 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:07.300488 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:07.420518 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '947bde0e827c45f5bab008d094816d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284d191aa82f453cabcfd18172f74099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:43:07.724705 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:07.803325 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 25 04:43:07.855547 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Searching for a device in session 20 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:43:07.855930 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '94315545-1fac-434f-9971-01dd561f2296', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:43:08.072390 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:08.171134 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Successfully created port: a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:43:08.307005 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Start building block device mappings for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 25 04:43:08.542173 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:43:08.542907 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:43:08.604248 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Found WWN 330000000029f2a87 for multipath device dm-9 {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 25 04:43:08.604604 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:43:08.605197 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '330000000029f2a87', 'path': '/dev/dm-9', 'multipath_id': '330000000029f2a87'} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:43:08.605197 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000029f2a87', 'path': '/dev/dm-9', 'multipath_id': '330000000029f2a87'} {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 25 04:43:08.824796 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:08.995152 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Successfully updated port: a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:43:09.046047 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:43:09.068862 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-a458e0ce-95d2-41dc-b99e-cd246e9b4b83 req-d14171e0-6ccf-44f3-b8a4-8f6a8a1995ed service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Received event network-changed-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:09.072277 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-a458e0ce-95d2-41dc-b99e-cd246e9b4b83 req-d14171e0-6ccf-44f3-b8a4-8f6a8a1995ed service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Refreshing instance network info cache due to event network-changed-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:43:09.072603 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a458e0ce-95d2-41dc-b99e-cd246e9b4b83 req-d14171e0-6ccf-44f3-b8a4-8f6a8a1995ed service nova] Acquiring lock "refresh_cache-ea0f9737-865a-4199-9077-b64e88af15db" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:43:09.072821 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a458e0ce-95d2-41dc-b99e-cd246e9b4b83 req-d14171e0-6ccf-44f3-b8a4-8f6a8a1995ed service nova] Acquired lock "refresh_cache-ea0f9737-865a-4199-9077-b64e88af15db" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:43:09.073097 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-a458e0ce-95d2-41dc-b99e-cd246e9b4b83 req-d14171e0-6ccf-44f3-b8a4-8f6a8a1995ed service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Refreshing network info cache for port a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:43:09.114815 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Calling os-brick to attach iSCSI Volume {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 25 04:43:09.114815 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a08f66b0-7f9c-47e4-9418-275768fa9e0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:43:09.114815 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:43:09.114815 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:43:09.114815 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a08f66b0-7f9c-47e4-9418-275768fa9e0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 25 04:43:09.129878 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:43:09.130682 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:43:09.131216 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:43:09.131471 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:43:09.132130 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:43:09.132457 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:43:09.146672 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:43:09.146672 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:09.153590 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:43:09.153590 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:09.162507 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e] added Jun 25 04:43:09.162507 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:43:09.162507 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:43:09.162507 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:43:09.162507 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:43:09.162507 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:43:09.162507 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:09.162854 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:43:09.163494 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0315(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:43:09.163494 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:43:09.167270 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e] added Jun 25 04:43:09.167270 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:43:09.167270 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:43:09.167270 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:43:09.167270 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:43:09.167270 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:43:09.167270 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:09.167270 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:43:09.167270 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0348(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:43:09.167790 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:43:09.324504 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Start spawning the instance on the hypervisor. {{(pid=98952) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 25 04:43:09.325755 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Creating instance directory {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 25 04:43:09.326257 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Creating image(s) Jun 25 04:43:09.326740 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:09.327358 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "/opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:09.327899 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "/opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:09.328582 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:09.332268 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:09.336498 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:09.436473 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.098s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:09.436473 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:09.437598 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:09.438355 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:09.442065 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:09.442804 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:09.499512 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "refresh_cache-ea0f9737-865a-4199-9077-b64e88af15db" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:43:09.528950 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.086s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:09.529527 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk 1073741824 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:09.559297 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.761s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:09.560675 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.118s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:09.561091 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:43:09.569579 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:43:09.570237 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Claim successful on node np0000003587 Jun 25 04:43:09.577569 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-a458e0ce-95d2-41dc-b99e-cd246e9b4b83 req-d14171e0-6ccf-44f3-b8a4-8f6a8a1995ed service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:09.586160 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk 1073741824" returned: 0 in 0.057s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:09.590721 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.151s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:09.590721 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:09.675139 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.085s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:09.675139 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk. size=1073741824 {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 25 04:43:09.675139 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:09.698014 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-a458e0ce-95d2-41dc-b99e-cd246e9b4b83 req-d14171e0-6ccf-44f3-b8a4-8f6a8a1995ed service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:43:09.768513 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:09.768879 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Cannot resize image /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk to a smaller size. {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 25 04:43:09.769227 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Created local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 25 04:43:09.769382 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Ensure instance console log exists: /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:43:09.769725 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:09.770105 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:09.770105 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:09.873879 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:09.926392 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-a458e0ce-95d2-41dc-b99e-cd246e9b4b83 req-d14171e0-6ccf-44f3-b8a4-8f6a8a1995ed service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:10.070254 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:43:10.072945 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:43:10.072945 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:10.072945 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:10.163876 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:43:10.167975 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.40.100 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:43:10.183010 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.50.100 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:43:10.199183 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:10.202856 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:10.210742 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27ebe4b23b624995a52b9313ff9e318a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d52ed3b8de460eb65a8fb4ad1b015d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:43:10.220036 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:10.231248 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:10.231248 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:10.231248 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:10.231248 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:10.231248 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:10.231248 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:10.231248 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:10.231248 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:10.231248 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:10.231248 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:10.231248 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:10.231248 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:10.231248 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:43:10.231835 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:10.231835 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:10.231835 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:10.231835 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:10.231835 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:10.231835 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:10.231835 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:10.231835 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:10.231835 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:10.231835 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:10.231835 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:10.231835 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:10.231835 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:43:10.250361 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:10.250361 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:10.250361 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:10.250361 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:10.250361 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:10.250361 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:10.250361 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:10.250361 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:10.250361 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:10.250361 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:10.250361 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:10.250361 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:10.250361 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:43:10.250361 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:10.250361 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:10.250361 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:10.250361 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:10.250361 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:10.250361 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:10.250361 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:10.250361 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:10.250361 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:10.250361 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:10.250361 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:10.250361 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:10.250361 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:43:10.296659 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e, portal: 192.168.40.100,3260] Jun 25 04:43:10.296659 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e, portal: 192.168.40.100,3260] successful. Jun 25 04:43:10.296659 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:10.310198 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:10.342433 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:10.342433 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:10.342433 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:10.342433 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:10.342433 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:10.342433 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:10.342433 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:10.342433 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:10.342433 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:10.342433 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:10.342433 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:10.342433 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:10.342433 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:10.342433 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:10.342433 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:43:10.343456 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:10.343456 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:10.343456 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:10.343456 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:10.343456 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:10.343456 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:10.343456 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:10.343456 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:10.343456 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:10.343456 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:10.343456 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:10.343456 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:10.343456 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:10.343456 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:10.343456 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:43:10.343456 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e, portal: 192.168.50.100,3260] Jun 25 04:43:10.343456 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e, portal: 192.168.50.100,3260] successful. Jun 25 04:43:10.343456 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:10.345435 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.214s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:43:10.345435 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Connected to 192.168.40.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:43:10.347990 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] HCTL ('19', '-', '-', 0) found on session 21 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:43:10.348130 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:43:10.363241 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:10.388453 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Searching for a device in session 21 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:43:10.388659 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a08f66b0-7f9c-47e4-9418-275768fa9e0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:43:10.412256 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:10.412256 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:10.412256 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:10.412256 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:10.412256 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:10.412256 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:10.412256 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:10.412256 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:10.412256 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:10.412256 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:10.412256 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:10.412256 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:10.412256 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:10.412256 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:10.412256 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:43:10.412895 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:10.412895 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:10.412895 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:10.412895 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:10.412895 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:10.412895 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:10.412895 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:10.412895 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:10.412895 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:10.412895 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:10.412895 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:10.412895 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:10.412895 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:10.412895 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:10.412895 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:43:10.412895 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.281s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:43:10.413434 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Connected to 192.168.50.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:43:10.415074 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] HCTL ('20', '-', '-', 0) found on session 22 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:43:10.415126 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:43:10.429548 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a458e0ce-95d2-41dc-b99e-cd246e9b4b83 req-d14171e0-6ccf-44f3-b8a4-8f6a8a1995ed service nova] Releasing lock "refresh_cache-ea0f9737-865a-4199-9077-b64e88af15db" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:43:10.430507 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquired lock "refresh_cache-ea0f9737-865a-4199-9077-b64e88af15db" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:43:10.430507 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:43:10.453036 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Searching for a device in session 22 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:43:10.453036 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a08f66b0-7f9c-47e4-9418-275768fa9e0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:43:10.493538 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d4522cef-7d3b-43d2-97db-81f1dcb3772c req-a2d078f0-7585-4c7a-93ed-04b48d260af9 service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Received event network-vif-unplugged-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:10.493794 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d4522cef-7d3b-43d2-97db-81f1dcb3772c req-a2d078f0-7585-4c7a-93ed-04b48d260af9 service nova] Acquiring lock "ea0f9737-865a-4199-9077-b64e88af15db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:10.493947 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d4522cef-7d3b-43d2-97db-81f1dcb3772c req-a2d078f0-7585-4c7a-93ed-04b48d260af9 service nova] Lock "ea0f9737-865a-4199-9077-b64e88af15db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:10.494070 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d4522cef-7d3b-43d2-97db-81f1dcb3772c req-a2d078f0-7585-4c7a-93ed-04b48d260af9 service nova] Lock "ea0f9737-865a-4199-9077-b64e88af15db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:10.494302 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d4522cef-7d3b-43d2-97db-81f1dcb3772c req-a2d078f0-7585-4c7a-93ed-04b48d260af9 service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] No waiting events found dispatching network-vif-unplugged-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:43:10.494431 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-d4522cef-7d3b-43d2-97db-81f1dcb3772c req-a2d078f0-7585-4c7a-93ed-04b48d260af9 service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Received unexpected event network-vif-unplugged-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 for instance with vm_state building and task_state spawning. Jun 25 04:43:10.572194 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 25 04:43:10.842236 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Successfully created port: 2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:43:11.056739 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:43:11.075519 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Start building block device mappings for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 25 04:43:11.134827 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 25 04:43:11.289798 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:11.388065 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:43:11.388885 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:43:11.495647 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Updating instance_info_cache with network_info: [{"id": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "address": "fa:16:3e:57:c0:7f", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa68140e2-5c", "ovs_interfaceid": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:11.497833 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:11.522904 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Successfully updated port: 2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:43:11.584848 np0000003587 nova-compute[98952]: INFO nova.virt.block_device [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Booting with volume-backed-image 4ecaf199-c1b9-4ce3-869c-178c170c1662 at /dev/vda Jun 25 04:43:11.605807 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-56fc7f5d-1fa8-4614-bdb4-163f1622bf94 req-828f9fcb-7979-4df9-8810-fe0fc3ba7739 service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Received event network-changed-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:11.605953 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-56fc7f5d-1fa8-4614-bdb4-163f1622bf94 req-828f9fcb-7979-4df9-8810-fe0fc3ba7739 service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Refreshing instance network info cache due to event network-changed-2a5c445e-b115-42f3-984d-bfe5af6670e4. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:43:11.606117 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-56fc7f5d-1fa8-4614-bdb4-163f1622bf94 req-828f9fcb-7979-4df9-8810-fe0fc3ba7739 service nova] Acquiring lock "refresh_cache-df96228c-c3b2-457d-9eb1-2e82186076f4" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:43:11.606239 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-56fc7f5d-1fa8-4614-bdb4-163f1622bf94 req-828f9fcb-7979-4df9-8810-fe0fc3ba7739 service nova] Acquired lock "refresh_cache-df96228c-c3b2-457d-9eb1-2e82186076f4" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:43:11.606396 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-56fc7f5d-1fa8-4614-bdb4-163f1622bf94 req-828f9fcb-7979-4df9-8810-fe0fc3ba7739 service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Refreshing network info cache for port 2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:43:11.891638 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:43:11.998353 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Releasing lock "refresh_cache-ea0f9737-865a-4199-9077-b64e88af15db" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:43:11.998931 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Instance network_info: |[{"id": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "address": "fa:16:3e:57:c0:7f", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa68140e2-5c", "ovs_interfaceid": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 25 04:43:12.001853 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Start _get_guest_xml network_info=[{"id": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "address": "fa:16:3e:57:c0:7f", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa68140e2-5c", "ovs_interfaceid": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '4ecaf199-c1b9-4ce3-869c-178c170c1662'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:43:12.008209 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:43:12.009969 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='ea0f9737-865a-4199-9077-b64e88af15db'), owner=OwnerMeta(userid='947bde0e827c45f5bab008d094816d8c', username='tempest-AttachVolumeMultiAttachTest-1256899935-project-member', projectid='284d191aa82f453cabcfd18172f74099', projectname='tempest-AttachVolumeMultiAttachTest-1256899935'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "address": "fa:16:3e:57:c0:7f", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa68140e2-5c", "ovs_interfaceid": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362592.0094118) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:43:12.011577 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:43:12.012324 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:43:12.013176 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:43:12.014095 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:43:12.016878 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:43:12.017269 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:43:12.017470 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:43:12.017611 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:43:12.017776 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:43:12.017895 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:43:12.018332 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:43:12.018718 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:43:12.019075 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:43:12.019235 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:43:12.019376 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:43:12.020390 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:43:12.028839 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "refresh_cache-df96228c-c3b2-457d-9eb1-2e82186076f4" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:43:12.039099 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:43:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='multiattach-server-0',id=13,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV/p3ZeuUk+pDtRyjEqB6LGacp/8M+rMj60nbQpQu7IIRoy9lFRhD1vsgSIFDZ+PjS4ytFpGVQZ3frW+0uH/J+qnA92sFXepo+od7tCOydqRChW2tpsraqZi+iIk6G08A==',key_name='tempest-keypair-462979399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='284d191aa82f453cabcfd18172f74099',ramdisk_id='',reservation_id='r-z9bdjah6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1256899935',owner_user_name='tempest-AttachVolumeMultiAttachTest-1256899935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:43:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='947bde0e827c45f5bab008d094816d8c',uuid=ea0f9737-865a-4199-9077-b64e88af15db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "address": "fa:16:3e:57:c0:7f", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa68140e2-5c", "ovs_interfaceid": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:43:12.039407 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converting VIF {"id": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "address": "fa:16:3e:57:c0:7f", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa68140e2-5c", "ovs_interfaceid": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:12.040258 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:c0:7f,bridge_name='br-int',has_traffic_filtering=True,id=a68140e2-5c7f-49c9-abbb-fbc11cf20cf2,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa68140e2-5c') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:12.041211 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lazy-loading 'pci_devices' on Instance uuid ea0f9737-865a-4199-9077-b64e88af15db {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:43:12.113079 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-56fc7f5d-1fa8-4614-bdb4-163f1622bf94 req-828f9fcb-7979-4df9-8810-fe0fc3ba7739 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:12.151372 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Found WWN 330000000abf4f6ed for multipath device dm-12 {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 25 04:43:12.151372 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:43:12.151372 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '330000000abf4f6ed', 'path': '/dev/dm-12', 'multipath_id': '330000000abf4f6ed'} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:43:12.151372 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000abf4f6ed', 'path': '/dev/dm-12', 'multipath_id': '330000000abf4f6ed'} {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 25 04:43:12.196643 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-56fc7f5d-1fa8-4614-bdb4-163f1622bf94 req-828f9fcb-7979-4df9-8810-fe0fc3ba7739 service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:43:12.402569 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.843s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:12.403471 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:43:12.408687 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-56fc7f5d-1fa8-4614-bdb4-163f1622bf94 req-828f9fcb-7979-4df9-8810-fe0fc3ba7739 service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:12.483358 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004531320000751293 future=) submitted to {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:43:12.483358 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:43:12.483701 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Emitting event Stopped> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:12.484468 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] VM Stopped (Lifecycle Event) Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] End _get_guest_xml xml= Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: ea0f9737-865a-4199-9077-b64e88af15db Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: instance-0000000d Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: 196608 Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: multiattach-server-0 Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: 2026-06-25 04:43:12 Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: 192 Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: True Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: bare Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: virtio Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: tempest-AttachVolumeMultiAttachTest-1256899935-project-member Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: tempest-AttachVolumeMultiAttachTest-1256899935 Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: ea0f9737-865a-4199-9077-b64e88af15db Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: ea0f9737-865a-4199-9077-b64e88af15db Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: hvm Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: 128 Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: Jun 25 04:43:12.546936 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:43:12.549648 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Preparing to wait for external event network-vif-plugged-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:43:12.549648 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "ea0f9737-865a-4199-9077-b64e88af15db-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:12.549648 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "ea0f9737-865a-4199-9077-b64e88af15db-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:12.549648 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "ea0f9737-865a-4199-9077-b64e88af15db-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:12.549648 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:43:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='multiattach-server-0',id=13,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV/p3ZeuUk+pDtRyjEqB6LGacp/8M+rMj60nbQpQu7IIRoy9lFRhD1vsgSIFDZ+PjS4ytFpGVQZ3frW+0uH/J+qnA92sFXepo+od7tCOydqRChW2tpsraqZi+iIk6G08A==',key_name='tempest-keypair-462979399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='284d191aa82f453cabcfd18172f74099',ramdisk_id='',reservation_id='r-z9bdjah6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1256899935',owner_user_name='tempest-AttachVolumeMultiAttachTest-1256899935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:43:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='947bde0e827c45f5bab008d094816d8c',uuid=ea0f9737-865a-4199-9077-b64e88af15db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "address": "fa:16:3e:57:c0:7f", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa68140e2-5c", "ovs_interfaceid": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:43:12.549648 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converting VIF {"id": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "address": "fa:16:3e:57:c0:7f", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa68140e2-5c", "ovs_interfaceid": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:12.549648 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:c0:7f,bridge_name='br-int',has_traffic_filtering=True,id=a68140e2-5c7f-49c9-abbb-fbc11cf20cf2,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa68140e2-5c') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:12.549648 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:c0:7f,bridge_name='br-int',has_traffic_filtering=True,id=a68140e2-5c7f-49c9-abbb-fbc11cf20cf2,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa68140e2-5c') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:43:12.550910 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:12.550910 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:12.550910 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:43:12.552830 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:12.552830 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e8c875a-e80f-53a7-a826-62f1db144f6e', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:12.554045 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:12.554045 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:12.556002 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:12.559643 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:12.559643 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa68140e2-5c, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:12.559643 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa68140e2-5c, col_values=(('qos', UUID('69465cdf-6a31-447e-bd17-cf99ad7331d0')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:12.559643 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa68140e2-5c, col_values=(('external_ids', {'iface-id': 'a68140e2-5c7f-49c9-abbb-fbc11cf20cf2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:c0:7f', 'vm-uuid': 'ea0f9737-865a-4199-9077-b64e88af15db'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:12.560228 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:12.561608 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:12.567382 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:12.568685 np0000003587 nova-compute[98952]: INFO os_vif [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:c0:7f,bridge_name='br-int',has_traffic_filtering=True,id=a68140e2-5c7f-49c9-abbb-fbc11cf20cf2,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa68140e2-5c') Jun 25 04:43:12.658432 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Calling os-brick to attach iSCSI Volume {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 25 04:43:12.658432 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:43:12.658432 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:43:12.658432 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:43:12.658432 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 25 04:43:12.672424 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:43:12.673342 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:43:12.674175 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:43:12.674630 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:43:12.674938 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:43:12.675220 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:43:12.687654 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:43:12.687654 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:12.692863 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:43:12.692863 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:12.701566 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9] added Jun 25 04:43:12.701566 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:43:12.701566 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:43:12.701566 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:43:12.701566 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:43:12.701566 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:43:12.701566 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:12.701566 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:43:12.701566 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0271(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:43:12.701903 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:43:12.706034 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9] added Jun 25 04:43:12.706034 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:43:12.706034 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:43:12.706034 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:43:12.706034 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:43:12.706034 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:43:12.706034 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:12.706034 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:43:12.706034 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0294(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:43:12.706034 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:43:12.912669 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:43:12.913642 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-56fc7f5d-1fa8-4614-bdb4-163f1622bf94 req-828f9fcb-7979-4df9-8810-fe0fc3ba7739 service nova] Releasing lock "refresh_cache-df96228c-c3b2-457d-9eb1-2e82186076f4" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:43:12.913918 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:43:12.914197 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:12.914435 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:12.916315 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquired lock "refresh_cache-df96228c-c3b2-457d-9eb1-2e82186076f4" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:43:12.916513 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:43:12.986583 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 775ef107-e7ca-4d94-b5ab-2ec8665a4906] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:13.009568 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f9bd46f11cd4d38bbf9926be137ca8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cdd814e374462e9477baf02d6c2fdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:43:13.266136 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:13.416860 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 25 04:43:13.499962 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:43:13.643584 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Successfully created port: 22b45284-c52f-466b-a2e1-f273384c1dbc {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:43:13.694158 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Acquiring lock "097ff869-4376-4450-9a31-5389fe5e44c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:13.694705 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "097ff869-4376-4450-9a31-5389fe5e44c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:13.702296 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:43:13.704846 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.40.100 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:43:13.720209 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:13.726208 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.50.100 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:43:13.730546 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:13.737232 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:13.743817 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:13.765517 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:13.774740 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:43:13.842905 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9, portal: 192.168.50.100,3260] Jun 25 04:43:13.842905 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9, portal: 192.168.50.100,3260] successful. Jun 25 04:43:13.842905 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:13.858441 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:13.893624 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:13.893624 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:13.893624 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:13.893624 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:13.893624 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:13.893624 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:13.893624 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:13.893624 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:13.893624 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:13.893624 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:13.893624 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:13.893624 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:13.893624 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:13.893624 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:13.893624 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:13.893624 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:43:13.894135 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:13.894135 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:13.894135 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:13.894135 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:13.894135 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:13.894135 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:13.894135 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:13.894135 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:13.894135 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:13.894135 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:13.894135 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:13.894135 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:13.894135 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:13.894135 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:13.894135 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:13.894135 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:43:13.894602 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.220s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:43:13.894602 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Connected to 192.168.50.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:43:13.895851 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] HCTL ('21', '-', '-', 0) found on session 23 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:43:13.895990 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:43:13.924506 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Updating instance_info_cache with network_info: [{"id": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "address": "fa:16:3e:e9:03:29", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5c445e-b1", "ovs_interfaceid": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:13.924785 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Start building block device mappings for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 25 04:43:13.932017 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Searching for a device in session 23 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:43:13.932193 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:43:14.092925 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:43:14.093115 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:43:14.093238 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No VIF found with MAC fa:16:3e:57:c0:7f, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:43:14.093745 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Using config drive Jun 25 04:43:14.197185 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:43:14.361408 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Successfully updated port: 22b45284-c52f-466b-a2e1-f273384c1dbc {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:43:14.423876 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-46adf9d4-dc6d-4acc-a274-28d05477ded0 req-6ada2f26-3fd0-44b4-a5cf-96437e42f9bc service nova] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Received event network-changed-22b45284-c52f-466b-a2e1-f273384c1dbc {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:14.424361 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-46adf9d4-dc6d-4acc-a274-28d05477ded0 req-6ada2f26-3fd0-44b4-a5cf-96437e42f9bc service nova] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Refreshing instance network info cache due to event network-changed-22b45284-c52f-466b-a2e1-f273384c1dbc. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:43:14.424361 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-46adf9d4-dc6d-4acc-a274-28d05477ded0 req-6ada2f26-3fd0-44b4-a5cf-96437e42f9bc service nova] Acquiring lock "refresh_cache-7671d823-fb04-46c9-80d9-e171d8032199" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:43:14.424361 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-46adf9d4-dc6d-4acc-a274-28d05477ded0 req-6ada2f26-3fd0-44b4-a5cf-96437e42f9bc service nova] Acquired lock "refresh_cache-7671d823-fb04-46c9-80d9-e171d8032199" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:43:14.424361 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-46adf9d4-dc6d-4acc-a274-28d05477ded0 req-6ada2f26-3fd0-44b4-a5cf-96437e42f9bc service nova] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Refreshing network info cache for port 22b45284-c52f-466b-a2e1-f273384c1dbc {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:43:14.427889 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Releasing lock "refresh_cache-df96228c-c3b2-457d-9eb1-2e82186076f4" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:43:14.428485 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Instance network_info: |[{"id": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "address": "fa:16:3e:e9:03:29", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5c445e-b1", "ovs_interfaceid": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 25 04:43:14.600622 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:14.774180 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:14.774433 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:14.777232 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Creating config drive at /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk.config Jun 25 04:43:14.780538 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:43:14.780733 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Claim successful on node np0000003587 Jun 25 04:43:14.788270 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4hk5hul0 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:14.832205 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4hk5hul0" returned: 0 in 0.044s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:14.848578 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9, portal: 192.168.40.100,3260] Jun 25 04:43:14.848578 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9, portal: 192.168.40.100,3260] successful. Jun 25 04:43:14.848578 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:14.859369 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:14.863965 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Acquiring lock "refresh_cache-7671d823-fb04-46c9-80d9-e171d8032199" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:43:14.876826 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:14.884936 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:14.884936 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:14.884936 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:14.884936 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:14.884936 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:14.884936 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:14.884936 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:14.884936 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:14.884936 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:14.884936 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:14.884936 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:14.884936 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:14.884936 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:14.884936 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:14.884936 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:14.884936 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:14.884936 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:43:14.885429 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:14.885429 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:14.885429 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:14.885429 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:14.885429 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:14.885429 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:14.885429 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:14.885429 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:14.885429 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:14.885429 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:14.885429 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:14.885429 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:14.885429 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:14.885429 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:14.885429 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:14.885429 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:14.885429 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:43:14.885910 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.212s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:43:14.885910 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Connected to 192.168.40.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:43:14.888841 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] HCTL ('22', '-', '-', 0) found on session 24 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:43:14.889038 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:43:14.907006 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Searching for a device in session 24 and hctl ['22', '*', '*', 0] yield: sdq {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:43:14.907195 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:43:14.926810 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-46adf9d4-dc6d-4acc-a274-28d05477ded0 req-6ada2f26-3fd0-44b4-a5cf-96437e42f9bc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:14.935206 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Start spawning the instance on the hypervisor. {{(pid=98952) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 25 04:43:14.936670 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Creating instance directory {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 25 04:43:14.937753 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Creating image(s) Jun 25 04:43:14.938153 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Acquiring lock "/opt/stack/data/nova/instances/7671d823-fb04-46c9-80d9-e171d8032199/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:14.938153 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "/opt/stack/data/nova/instances/7671d823-fb04-46c9-80d9-e171d8032199/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:14.938709 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "/opt/stack/data/nova/instances/7671d823-fb04-46c9-80d9-e171d8032199/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:14.939500 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:14.944454 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:14.945958 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:15.021512 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-46adf9d4-dc6d-4acc-a274-28d05477ded0 req-6ada2f26-3fd0-44b4-a5cf-96437e42f9bc service nova] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:43:15.043654 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.097s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:15.044224 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Acquiring lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:15.044710 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:15.045743 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:15.056872 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:15.057365 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:15.157872 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.100s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:15.159139 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/7671d823-fb04-46c9-80d9-e171d8032199/disk 1073741824 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:15.230690 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/7671d823-fb04-46c9-80d9-e171d8032199/disk 1073741824" returned: 0 in 0.069s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:15.230690 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.184s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:15.230690 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:15.261649 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-46adf9d4-dc6d-4acc-a274-28d05477ded0 req-6ada2f26-3fd0-44b4-a5cf-96437e42f9bc service nova] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:15.268069 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.80', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003587', 'execute': None}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:43:15.283528 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.scaleio [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98952) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 25 04:43:15.325406 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): nvme version {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:15.340156 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.110s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:15.342448 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7671d823-fb04-46c9-80d9-e171d8032199/disk. size=1073741824 {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 25 04:43:15.343438 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7671d823-fb04-46c9-80d9-e171d8032199/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:15.368158 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] 'nvme version' failed. Not Retrying. {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 04:43:15.370109 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:15.376823 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] nvme not present on system {{(pid=98952) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 25 04:43:15.389215 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98952) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 25 04:43:15.394674 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.lightos [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Current host hostNQN and IP(s) are ['10.4.3.80', 'fe80::f816:3eff:feea:dfe4', '192.168.40.6', 'fe80::f816:3eff:fe4f:7c42', '192.168.50.6', 'fe80::f816:3eff:fe6c:e6a6', '192.168.10.6', 'fe80::f816:3eff:fe17:d749', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::b035:28ff:fe70:6f4a', 'fe80::fc16:3eff:fe8c:f883', 'fe80::483f:f2ff:fe48:75ca', 'fe80::fc16:3eff:fe78:7ac8', 'fe80::1038:1dff:fe1c:d44b', 'fe80::fc16:3eff:fe3a:4858', 'fe80::fc16:3eff:fe4f:4083', 'fe80::fc16:3eff:fee6:e022', 'fe80::fc16:3eff:feab:c3d8', 'fe80::bca6:aaff:fef0:a5cf', 'fe80::fc16:3eff:fe6d:cc4e', 'fe80::fc16:3eff:fe07:d0f0', 'fe80::fc16:3eff:fee6:936b', 'fe80::fc16:3eff:fed3:389d', 'fe80::fc16:3eff:fe06:1da0', 'fe80::6086:d2ff:fe1e:62e1', 'fe80::fc16:3eff:fefe:a095', 'fe80::b4c2:93ff:fe6e:4d89', 'fe80::fc16:3eff:feee:97a2', 'fe80::fc16:3eff:fe57:c07f'] Jun 25 04:43:15.394674 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 25 04:43:15.394674 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] LIGHTOS: no hostnqn found. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 25 04:43:15.394674 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.80', 'host': 'np0000003587', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c81886224652', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a1feb13-40e2-4ac6-989e-b08a6fc0f283', 'nvme_native_multipath': False} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:43:15.394674 np0000003587 nova-compute[98952]: DEBUG nova.virt.block_device [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Updating existing volume attachment record: 8d139240-e3dc-47e5-8f0c-6a1244e38c8a {{(pid=98952) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 25 04:43:15.403280 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:15.453897 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7671d823-fb04-46c9-80d9-e171d8032199/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:15.454572 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Cannot resize image /opt/stack/data/nova/instances/7671d823-fb04-46c9-80d9-e171d8032199/disk to a smaller size. {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 25 04:43:15.454572 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Created local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 25 04:43:15.454829 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Ensure instance console log exists: /opt/stack/data/nova/instances/7671d823-fb04-46c9-80d9-e171d8032199/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:43:15.455297 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:15.455463 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:15.455663 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:15.486973 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:15.565225 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:15.569505 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:15.631974 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:15.707533 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 25 04:43:15.771570 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-46adf9d4-dc6d-4acc-a274-28d05477ded0 req-6ada2f26-3fd0-44b4-a5cf-96437e42f9bc service nova] Releasing lock "refresh_cache-7671d823-fb04-46c9-80d9-e171d8032199" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:43:15.772069 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Acquired lock "refresh_cache-7671d823-fb04-46c9-80d9-e171d8032199" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:43:15.772461 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:43:16.315468 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:16.315698 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: ea0f9737-865a-4199-9077-b64e88af15db] VM Started (Lifecycle Event) Jun 25 04:43:16.356668 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:43:16.590499 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:43:16.590499 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:43:16.608963 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:16.727452 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Found WWN 1StorPooliSCSI_DISK_1034578903445798943 for multipath device dm-13 {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 25 04:43:16.727452 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.067s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:43:16.727452 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] <== connect_volume: return (4067ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798943', 'path': '/dev/dm-13', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445798943'} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:43:16.727452 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798943', 'path': '/dev/dm-13', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445798943'} {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 25 04:43:16.756034 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Updating instance_info_cache with network_info: [{"id": "22b45284-c52f-466b-a2e1-f273384c1dbc", "address": "fa:16:3e:98:32:46", "network": {"id": "d59f1de2-a0fd-4318-9724-66a1bbe8ec86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-557005970-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "00cdd814e374462e9477baf02d6c2fdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b45284-c5", "ovs_interfaceid": "22b45284-c52f-466b-a2e1-f273384c1dbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:16.819347 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:16.825585 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Paused> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:16.825585 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: ea0f9737-865a-4199-9077-b64e88af15db] VM Paused (Lifecycle Event) Jun 25 04:43:17.093453 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:43:17.239126 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-537495923',id=12,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTa58cRFRWbbTonGFe1bcwC1cM5TfvMm5/ily9Wj5GN+GBKU2guWLZGoTDoxD7RBf8OLyMFDHq2HS1DBYy4i3i4VGt3td4oZT929qL3XO3APtqNhUYeVDjYIUqmMs06wg==',key_name='tempest-keypair-740147084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40a42527a8b24135b741fe2c38dc14b0',ramdisk_id='',reservation_id='r-uvd0ozk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2097804610',owner_user_name='tempest-TaggedBootDevicesTest-2097804610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e73054ab2cbd425cb182705f0ebfb7a5',uuid=25ee71dc-21c1-4ed4-b3d4-7f8cc107a863,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22fd01da-9056-4cd0-8489-c9f005bb66a5", "address": "fa:16:3e:cc:30:bf", "network": {"id": "e2c0ccd0-a308-4fd9-8b43-472d9a2acb3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-814024004-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22fd01da-90", "ovs_interfaceid": "22fd01da-9056-4cd0-8489-c9f005bb66a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:43:17.239327 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converting VIF {"id": "22fd01da-9056-4cd0-8489-c9f005bb66a5", "address": "fa:16:3e:cc:30:bf", "network": {"id": "e2c0ccd0-a308-4fd9-8b43-472d9a2acb3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-814024004-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22fd01da-90", "ovs_interfaceid": "22fd01da-9056-4cd0-8489-c9f005bb66a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:17.240041 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:30:bf,bridge_name='br-int',has_traffic_filtering=True,id=22fd01da-9056-4cd0-8489-c9f005bb66a5,network=Network(e2c0ccd0-a308-4fd9-8b43-472d9a2acb3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22fd01da-90') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:17.240870 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-537495923',id=12,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTa58cRFRWbbTonGFe1bcwC1cM5TfvMm5/ily9Wj5GN+GBKU2guWLZGoTDoxD7RBf8OLyMFDHq2HS1DBYy4i3i4VGt3td4oZT929qL3XO3APtqNhUYeVDjYIUqmMs06wg==',key_name='tempest-keypair-740147084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40a42527a8b24135b741fe2c38dc14b0',ramdisk_id='',reservation_id='r-uvd0ozk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2097804610',owner_user_name='tempest-TaggedBootDevicesTest-2097804610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e73054ab2cbd425cb182705f0ebfb7a5',uuid=25ee71dc-21c1-4ed4-b3d4-7f8cc107a863,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a36eb1f7-4779-4078-a224-bc487abd01a6", "address": "fa:16:3e:aa:4f:74", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36eb1f7-47", "ovs_interfaceid": "a36eb1f7-4779-4078-a224-bc487abd01a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:43:17.241063 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converting VIF {"id": "a36eb1f7-4779-4078-a224-bc487abd01a6", "address": "fa:16:3e:aa:4f:74", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36eb1f7-47", "ovs_interfaceid": "a36eb1f7-4779-4078-a224-bc487abd01a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:17.241567 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:4f:74,bridge_name='br-int',has_traffic_filtering=True,id=a36eb1f7-4779-4078-a224-bc487abd01a6,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa36eb1f7-47') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:17.242448 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-537495923',id=12,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTa58cRFRWbbTonGFe1bcwC1cM5TfvMm5/ily9Wj5GN+GBKU2guWLZGoTDoxD7RBf8OLyMFDHq2HS1DBYy4i3i4VGt3td4oZT929qL3XO3APtqNhUYeVDjYIUqmMs06wg==',key_name='tempest-keypair-740147084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40a42527a8b24135b741fe2c38dc14b0',ramdisk_id='',reservation_id='r-uvd0ozk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2097804610',owner_user_name='tempest-TaggedBootDevicesTest-2097804610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e73054ab2cbd425cb182705f0ebfb7a5',uuid=25ee71dc-21c1-4ed4-b3d4-7f8cc107a863,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff5a5c31-e634-489a-b565-418e87aaa11b", "address": "fa:16:3e:42:3a:ef", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5a5c31-e6", "ovs_interfaceid": "ff5a5c31-e634-489a-b565-418e87aaa11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:43:17.242606 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converting VIF {"id": "ff5a5c31-e634-489a-b565-418e87aaa11b", "address": "fa:16:3e:42:3a:ef", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5a5c31-e6", "ovs_interfaceid": "ff5a5c31-e634-489a-b565-418e87aaa11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:17.243122 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:3a:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff5a5c31-e634-489a-b565-418e87aaa11b,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff5a5c31-e6') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:17.243835 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-537495923',id=12,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTa58cRFRWbbTonGFe1bcwC1cM5TfvMm5/ily9Wj5GN+GBKU2guWLZGoTDoxD7RBf8OLyMFDHq2HS1DBYy4i3i4VGt3td4oZT929qL3XO3APtqNhUYeVDjYIUqmMs06wg==',key_name='tempest-keypair-740147084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40a42527a8b24135b741fe2c38dc14b0',ramdisk_id='',reservation_id='r-uvd0ozk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2097804610',owner_user_name='tempest-TaggedBootDevicesTest-2097804610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e73054ab2cbd425cb182705f0ebfb7a5',uuid=25ee71dc-21c1-4ed4-b3d4-7f8cc107a863,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7d7f523-bf9e-4f8f-881d-9d05c514eb54", "address": "fa:16:3e:e8:ba:ea", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d7f523-bf", "ovs_interfaceid": "a7d7f523-bf9e-4f8f-881d-9d05c514eb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:43:17.243835 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converting VIF {"id": "a7d7f523-bf9e-4f8f-881d-9d05c514eb54", "address": "fa:16:3e:e8:ba:ea", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d7f523-bf", "ovs_interfaceid": "a7d7f523-bf9e-4f8f-881d-9d05c514eb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:17.244311 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ba:ea,bridge_name='br-int',has_traffic_filtering=True,id=a7d7f523-bf9e-4f8f-881d-9d05c514eb54,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d7f523-bf') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:17.244985 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-537495923',id=12,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTa58cRFRWbbTonGFe1bcwC1cM5TfvMm5/ily9Wj5GN+GBKU2guWLZGoTDoxD7RBf8OLyMFDHq2HS1DBYy4i3i4VGt3td4oZT929qL3XO3APtqNhUYeVDjYIUqmMs06wg==',key_name='tempest-keypair-740147084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40a42527a8b24135b741fe2c38dc14b0',ramdisk_id='',reservation_id='r-uvd0ozk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2097804610',owner_user_name='tempest-TaggedBootDevicesTest-2097804610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e73054ab2cbd425cb182705f0ebfb7a5',uuid=25ee71dc-21c1-4ed4-b3d4-7f8cc107a863,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed1393f8-f25b-489d-9635-82b920d33137", "address": "fa:16:3e:a7:57:df", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped1393f8-f2", "ovs_interfaceid": "ed1393f8-f25b-489d-9635-82b920d33137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:43:17.245173 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converting VIF {"id": "ed1393f8-f25b-489d-9635-82b920d33137", "address": "fa:16:3e:a7:57:df", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped1393f8-f2", "ovs_interfaceid": "ed1393f8-f25b-489d-9635-82b920d33137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:17.245540 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:57:df,bridge_name='br-int',has_traffic_filtering=True,id=ed1393f8-f25b-489d-9635-82b920d33137,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped1393f8-f2') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:17.246197 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-537495923',id=12,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTa58cRFRWbbTonGFe1bcwC1cM5TfvMm5/ily9Wj5GN+GBKU2guWLZGoTDoxD7RBf8OLyMFDHq2HS1DBYy4i3i4VGt3td4oZT929qL3XO3APtqNhUYeVDjYIUqmMs06wg==',key_name='tempest-keypair-740147084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40a42527a8b24135b741fe2c38dc14b0',ramdisk_id='',reservation_id='r-uvd0ozk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2097804610',owner_user_name='tempest-TaggedBootDevicesTest-2097804610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e73054ab2cbd425cb182705f0ebfb7a5',uuid=25ee71dc-21c1-4ed4-b3d4-7f8cc107a863,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2af2f66c-7de8-49e4-badd-16d0764caff6", "address": "fa:16:3e:fa:99:7d", "network": {"id": "dbbc0276-7726-40fd-b3ee-f5a7887f5e72", "bridge": "br-int", "label": "tempest-device-tagging-net2-1967790487", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af2f66c-7d", "ovs_interfaceid": "2af2f66c-7de8-49e4-badd-16d0764caff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:43:17.246426 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converting VIF {"id": "2af2f66c-7de8-49e4-badd-16d0764caff6", "address": "fa:16:3e:fa:99:7d", "network": {"id": "dbbc0276-7726-40fd-b3ee-f5a7887f5e72", "bridge": "br-int", "label": "tempest-device-tagging-net2-1967790487", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af2f66c-7d", "ovs_interfaceid": "2af2f66c-7de8-49e4-badd-16d0764caff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:17.246883 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:99:7d,bridge_name='br-int',has_traffic_filtering=True,id=2af2f66c-7de8-49e4-badd-16d0764caff6,network=Network(dbbc0276-7726-40fd-b3ee-f5a7887f5e72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2af2f66c-7d') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:17.247677 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-537495923',id=12,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTa58cRFRWbbTonGFe1bcwC1cM5TfvMm5/ily9Wj5GN+GBKU2guWLZGoTDoxD7RBf8OLyMFDHq2HS1DBYy4i3i4VGt3td4oZT929qL3XO3APtqNhUYeVDjYIUqmMs06wg==',key_name='tempest-keypair-740147084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40a42527a8b24135b741fe2c38dc14b0',ramdisk_id='',reservation_id='r-uvd0ozk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2097804610',owner_user_name='tempest-TaggedBootDevicesTest-2097804610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e73054ab2cbd425cb182705f0ebfb7a5',uuid=25ee71dc-21c1-4ed4-b3d4-7f8cc107a863,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07a46cd4-912b-4863-8b8f-f345fe260bd0", "address": "fa:16:3e:95:90:8b", "network": {"id": "dbbc0276-7726-40fd-b3ee-f5a7887f5e72", "bridge": "br-int", "label": "tempest-device-tagging-net2-1967790487", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a46cd4-91", "ovs_interfaceid": "07a46cd4-912b-4863-8b8f-f345fe260bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:43:17.251136 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converting VIF {"id": "07a46cd4-912b-4863-8b8f-f345fe260bd0", "address": "fa:16:3e:95:90:8b", "network": {"id": "dbbc0276-7726-40fd-b3ee-f5a7887f5e72", "bridge": "br-int", "label": "tempest-device-tagging-net2-1967790487", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a46cd4-91", "ovs_interfaceid": "07a46cd4-912b-4863-8b8f-f345fe260bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:17.252193 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=07a46cd4-912b-4863-8b8f-f345fe260bd0,network=Network(dbbc0276-7726-40fd-b3ee-f5a7887f5e72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a46cd4-91') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:17.253030 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lazy-loading 'pci_devices' on Instance uuid 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:43:17.262293 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Releasing lock "refresh_cache-7671d823-fb04-46c9-80d9-e171d8032199" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:43:17.262293 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Instance network_info: |[{"id": "22b45284-c52f-466b-a2e1-f273384c1dbc", "address": "fa:16:3e:98:32:46", "network": {"id": "d59f1de2-a0fd-4318-9724-66a1bbe8ec86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-557005970-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "00cdd814e374462e9477baf02d6c2fdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b45284-c5", "ovs_interfaceid": "22b45284-c52f-466b-a2e1-f273384c1dbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 25 04:43:17.273745 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Start _get_guest_xml network_info=[{"id": "22b45284-c52f-466b-a2e1-f273384c1dbc", "address": "fa:16:3e:98:32:46", "network": {"id": "d59f1de2-a0fd-4318-9724-66a1bbe8ec86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-557005970-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "00cdd814e374462e9477baf02d6c2fdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b45284-c5", "ovs_interfaceid": "22b45284-c52f-466b-a2e1-f273384c1dbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '4ecaf199-c1b9-4ce3-869c-178c170c1662'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:43:17.276359 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:43:17.277947 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-209994954', uuid='7671d823-fb04-46c9-80d9-e171d8032199'), owner=OwnerMeta(userid='7f9bd46f11cd4d38bbf9926be137ca8e', username='tempest-VolumesActionsTest-93709413-project-member', projectid='00cdd814e374462e9477baf02d6c2fdb', projectname='tempest-VolumesActionsTest-93709413'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "22b45284-c52f-466b-a2e1-f273384c1dbc", "address": "fa:16:3e:98:32:46", "network": {"id": "d59f1de2-a0fd-4318-9724-66a1bbe8ec86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-557005970-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "00cdd814e374462e9477baf02d6c2fdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b45284-c5", "ovs_interfaceid": "22b45284-c52f-466b-a2e1-f273384c1dbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362597.2774136) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:43:17.279181 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:43:17.279698 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:43:17.280520 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:43:17.281730 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:43:17.281831 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:43:17.282211 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:43:17.282413 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:43:17.283784 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:43:17.283986 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:43:17.284141 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:43:17.284300 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:43:17.284567 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:43:17.284760 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:43:17.284925 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:43:17.285093 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:43:17.285281 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:43:17.303279 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-209994954',display_name='tempest-VolumesActionsTest-instance-209994954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-volumesactionstest-instance-209994954',id=15,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00cdd814e374462e9477baf02d6c2fdb',ramdisk_id='',reservation_id='r-2ejqrb53',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-93709413',owner_user_name='tempest-VolumesActionsTest-93709413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:43:14Z,user_data=None,user_id='7f9bd46f11cd4d38bbf9926be137ca8e',uuid=7671d823-fb04-46c9-80d9-e171d8032199,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22b45284-c52f-466b-a2e1-f273384c1dbc", "address": "fa:16:3e:98:32:46", "network": {"id": "d59f1de2-a0fd-4318-9724-66a1bbe8ec86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-557005970-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "00cdd814e374462e9477baf02d6c2fdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b45284-c5", "ovs_interfaceid": "22b45284-c52f-466b-a2e1-f273384c1dbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:43:17.303530 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Converting VIF {"id": "22b45284-c52f-466b-a2e1-f273384c1dbc", "address": "fa:16:3e:98:32:46", "network": {"id": "d59f1de2-a0fd-4318-9724-66a1bbe8ec86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-557005970-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "00cdd814e374462e9477baf02d6c2fdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b45284-c5", "ovs_interfaceid": "22b45284-c52f-466b-a2e1-f273384c1dbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:17.304121 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:32:46,bridge_name='br-int',has_traffic_filtering=True,id=22b45284-c52f-466b-a2e1-f273384c1dbc,network=Network(d59f1de2-a0fd-4318-9724-66a1bbe8ec86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b45284-c5') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:17.305131 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lazy-loading 'pci_devices' on Instance uuid 7671d823-fb04-46c9-80d9-e171d8032199 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:43:17.328578 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:17.330646 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:43:17.561962 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Start spawning the instance on the hypervisor. {{(pid=98952) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 25 04:43:17.561962 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Creating instance directory {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 25 04:43:17.561962 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Creating image(s) Jun 25 04:43:17.561962 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Did not create local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 25 04:43:17.561962 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Ensure instance console log exists: /opt/stack/data/nova/instances/df96228c-c3b2-457d-9eb1-2e82186076f4/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:43:17.562782 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:17.563069 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:17.563474 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:17.563946 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Start _get_guest_xml network_info=[{"id": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "address": "fa:16:3e:e9:03:29", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5c445e-b1", "ovs_interfaceid": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'df96228c-c3b2-457d-9eb1-2e82186076f4', 'attached_at': '', 'detached_at': '', 'volume_id': '31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'serial': '31e8293d-50f2-4271-8cc5-bdd52f895f6d'}, 'attachment_id': '8d139240-e3dc-47e5-8f0c-6a1244e38c8a', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:43:17.569831 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:43:17.569831 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1478758735', uuid='df96228c-c3b2-457d-9eb1-2e82186076f4'), owner=OwnerMeta(userid='27ebe4b23b624995a52b9313ff9e318a', username='tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member', projectid='a5d52ed3b8de460eb65a8fb4ad1b015d', projectname='tempest-ServerBootFromVolumeStableRescueTest-6878904'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "address": "fa:16:3e:e9:03:29", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5c445e-b1", "ovs_interfaceid": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362597.5686967) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:43:17.570129 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.571436 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:43:17.571956 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:43:17.572859 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:43:17.573105 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:43:17.573911 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:43:17.574332 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:43:17.576426 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:43:17.576426 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:43:17.576426 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:43:17.576426 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:43:17.576426 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:43:17.576426 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:43:17.576426 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:43:17.576426 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:43:17.576426 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:43:17.576426 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:43:17.588057 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Calling os-brick to attach iSCSI Volume {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 25 04:43:17.588685 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:43:17.589654 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:43:17.589654 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:43:17.589654 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 25 04:43:17.600539 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.826s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:17.601017 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:43:17.604975 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:43:17.608656 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:43:17.609355 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:43:17.609736 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:43:17.610061 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:43:17.610244 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:43:17.623088 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:43:17.623088 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:17.628358 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:43:17.628358 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:17.638516 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d] added Jun 25 04:43:17.638516 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:43:17.638516 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:43:17.638516 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:43:17.638516 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:43:17.638516 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:43:17.638516 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:17.638516 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:43:17.638516 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0278(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:43:17.638516 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:43:17.640294 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d] added Jun 25 04:43:17.640294 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:43:17.640294 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:43:17.640294 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:43:17.640294 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:43:17.640294 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:43:17.640294 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:17.642066 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:43:17.642066 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0311(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:43:17.642066 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] End _get_guest_xml xml= Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863 Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: instance-0000000c Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: 196608 Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: tempest-device-tagging-server-537495923 Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: 2026-06-25 04:43:05 Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: 192 Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: True Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: bare Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: virtio Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: tempest-TaggedBootDevicesTest-2097804610-project-member Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: tempest-TaggedBootDevicesTest-2097804610 Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863 Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863 Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: hvm Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: 128 Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: 94315545-1fac-434f-9971-01dd561f2296 Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: a08f66b0-7f9c-47e4-9418-275768fa9e0e Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: 88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: Jun 25 04:43:17.756204 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Preparing to wait for external event network-vif-plugged-22fd01da-9056-4cd0-8489-c9f005bb66a5 {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Preparing to wait for external event network-vif-plugged-a36eb1f7-4779-4078-a224-bc487abd01a6 {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Preparing to wait for external event network-vif-plugged-ff5a5c31-e634-489a-b565-418e87aaa11b {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Preparing to wait for external event network-vif-plugged-a7d7f523-bf9e-4f8f-881d-9d05c514eb54 {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Preparing to wait for external event network-vif-plugged-ed1393f8-f25b-489d-9635-82b920d33137 {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Preparing to wait for external event network-vif-plugged-2af2f66c-7de8-49e4-badd-16d0764caff6 {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Preparing to wait for external event network-vif-plugged-07a46cd4-912b-4863-8b8f-f345fe260bd0 {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:17.763122 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:17.763916 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-537495923',id=12,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTa58cRFRWbbTonGFe1bcwC1cM5TfvMm5/ily9Wj5GN+GBKU2guWLZGoTDoxD7RBf8OLyMFDHq2HS1DBYy4i3i4VGt3td4oZT929qL3XO3APtqNhUYeVDjYIUqmMs06wg==',key_name='tempest-keypair-740147084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40a42527a8b24135b741fe2c38dc14b0',ramdisk_id='',reservation_id='r-uvd0ozk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2097804610',owner_user_name='tempest-TaggedBootDevicesTest-2097804610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e73054ab2cbd425cb182705f0ebfb7a5',uuid=25ee71dc-21c1-4ed4-b3d4-7f8cc107a863,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22fd01da-9056-4cd0-8489-c9f005bb66a5", "address": "fa:16:3e:cc:30:bf", "network": {"id": "e2c0ccd0-a308-4fd9-8b43-472d9a2acb3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-814024004-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22fd01da-90", "ovs_interfaceid": "22fd01da-9056-4cd0-8489-c9f005bb66a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:43:17.763916 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converting VIF {"id": "22fd01da-9056-4cd0-8489-c9f005bb66a5", "address": "fa:16:3e:cc:30:bf", "network": {"id": "e2c0ccd0-a308-4fd9-8b43-472d9a2acb3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-814024004-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22fd01da-90", "ovs_interfaceid": "22fd01da-9056-4cd0-8489-c9f005bb66a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:17.763916 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:30:bf,bridge_name='br-int',has_traffic_filtering=True,id=22fd01da-9056-4cd0-8489-c9f005bb66a5,network=Network(e2c0ccd0-a308-4fd9-8b43-472d9a2acb3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22fd01da-90') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:17.763916 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:30:bf,bridge_name='br-int',has_traffic_filtering=True,id=22fd01da-9056-4cd0-8489-c9f005bb66a5,network=Network(e2c0ccd0-a308-4fd9-8b43-472d9a2acb3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22fd01da-90') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:43:17.763916 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.763916 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.763916 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:43:17.765165 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.765165 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3b1d3b98-d0b6-5589-9151-3f85d8c370c1', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.765768 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.766629 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:17.767982 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.771322 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.771567 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22fd01da-90, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.771988 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22fd01da-90, col_values=(('qos', UUID('f8bc9812-029f-4b0f-8b11-8eda4727bf4a')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.773136 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22fd01da-90, col_values=(('external_ids', {'iface-id': '22fd01da-9056-4cd0-8489-c9f005bb66a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:30:bf', 'vm-uuid': '25ee71dc-21c1-4ed4-b3d4-7f8cc107a863'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.774224 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.775866 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:17.781871 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.782995 np0000003587 nova-compute[98952]: INFO os_vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:30:bf,bridge_name='br-int',has_traffic_filtering=True,id=22fd01da-9056-4cd0-8489-c9f005bb66a5,network=Network(e2c0ccd0-a308-4fd9-8b43-472d9a2acb3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22fd01da-90') Jun 25 04:43:17.783691 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-537495923',id=12,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTa58cRFRWbbTonGFe1bcwC1cM5TfvMm5/ily9Wj5GN+GBKU2guWLZGoTDoxD7RBf8OLyMFDHq2HS1DBYy4i3i4VGt3td4oZT929qL3XO3APtqNhUYeVDjYIUqmMs06wg==',key_name='tempest-keypair-740147084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40a42527a8b24135b741fe2c38dc14b0',ramdisk_id='',reservation_id='r-uvd0ozk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2097804610',owner_user_name='tempest-TaggedBootDevicesTest-2097804610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e73054ab2cbd425cb182705f0ebfb7a5',uuid=25ee71dc-21c1-4ed4-b3d4-7f8cc107a863,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a36eb1f7-4779-4078-a224-bc487abd01a6", "address": "fa:16:3e:aa:4f:74", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36eb1f7-47", "ovs_interfaceid": "a36eb1f7-4779-4078-a224-bc487abd01a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:43:17.783923 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converting VIF {"id": "a36eb1f7-4779-4078-a224-bc487abd01a6", "address": "fa:16:3e:aa:4f:74", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36eb1f7-47", "ovs_interfaceid": "a36eb1f7-4779-4078-a224-bc487abd01a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:17.784620 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:4f:74,bridge_name='br-int',has_traffic_filtering=True,id=a36eb1f7-4779-4078-a224-bc487abd01a6,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa36eb1f7-47') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:17.784900 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:4f:74,bridge_name='br-int',has_traffic_filtering=True,id=a36eb1f7-4779-4078-a224-bc487abd01a6,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa36eb1f7-47') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:43:17.785193 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.785687 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.785840 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:43:17.786816 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.786945 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '531c10d6-9e39-5c3c-8680-a8cd12dac190', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.788740 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.788946 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:17.797348 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.802914 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.803183 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa36eb1f7-47, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.803608 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa36eb1f7-47, col_values=(('qos', UUID('7e4e0c9e-20de-4815-8164-03f546694707')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.803796 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa36eb1f7-47, col_values=(('external_ids', {'iface-id': 'a36eb1f7-4779-4078-a224-bc487abd01a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:4f:74', 'vm-uuid': '25ee71dc-21c1-4ed4-b3d4-7f8cc107a863'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.804865 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.806406 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] End _get_guest_xml xml= Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: 7671d823-fb04-46c9-80d9-e171d8032199 Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: instance-0000000f Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: 196608 Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: tempest-VolumesActionsTest-instance-209994954 Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: 2026-06-25 04:43:17 Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: 192 Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: True Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: bare Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: virtio Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: tempest-VolumesActionsTest-93709413-project-member Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: tempest-VolumesActionsTest-93709413 Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: 7671d823-fb04-46c9-80d9-e171d8032199 Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: 7671d823-fb04-46c9-80d9-e171d8032199 Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: hvm Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: 128 Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: Jun 25 04:43:17.809346 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:43:17.812055 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Preparing to wait for external event network-vif-plugged-22b45284-c52f-466b-a2e1-f273384c1dbc {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:43:17.812055 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Acquiring lock "7671d823-fb04-46c9-80d9-e171d8032199-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:17.812055 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "7671d823-fb04-46c9-80d9-e171d8032199-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:17.812055 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "7671d823-fb04-46c9-80d9-e171d8032199-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:17.812055 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-209994954',display_name='tempest-VolumesActionsTest-instance-209994954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-volumesactionstest-instance-209994954',id=15,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00cdd814e374462e9477baf02d6c2fdb',ramdisk_id='',reservation_id='r-2ejqrb53',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-93709413',owner_user_name='tempest-VolumesActionsTest-93709413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:43:14Z,user_data=None,user_id='7f9bd46f11cd4d38bbf9926be137ca8e',uuid=7671d823-fb04-46c9-80d9-e171d8032199,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22b45284-c52f-466b-a2e1-f273384c1dbc", "address": "fa:16:3e:98:32:46", "network": {"id": "d59f1de2-a0fd-4318-9724-66a1bbe8ec86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-557005970-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "00cdd814e374462e9477baf02d6c2fdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b45284-c5", "ovs_interfaceid": "22b45284-c52f-466b-a2e1-f273384c1dbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:43:17.812055 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Converting VIF {"id": "22b45284-c52f-466b-a2e1-f273384c1dbc", "address": "fa:16:3e:98:32:46", "network": {"id": "d59f1de2-a0fd-4318-9724-66a1bbe8ec86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-557005970-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "00cdd814e374462e9477baf02d6c2fdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b45284-c5", "ovs_interfaceid": "22b45284-c52f-466b-a2e1-f273384c1dbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:17.812055 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:32:46,bridge_name='br-int',has_traffic_filtering=True,id=22b45284-c52f-466b-a2e1-f273384c1dbc,network=Network(d59f1de2-a0fd-4318-9724-66a1bbe8ec86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b45284-c5') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:17.812055 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:32:46,bridge_name='br-int',has_traffic_filtering=True,id=22b45284-c52f-466b-a2e1-f273384c1dbc,network=Network(d59f1de2-a0fd-4318-9724-66a1bbe8ec86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b45284-c5') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:43:17.819902 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.820748 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.820932 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.821125 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:43:17.821752 np0000003587 nova-compute[98952]: INFO os_vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:4f:74,bridge_name='br-int',has_traffic_filtering=True,id=a36eb1f7-4779-4078-a224-bc487abd01a6,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa36eb1f7-47') Jun 25 04:43:17.823409 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-537495923',id=12,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTa58cRFRWbbTonGFe1bcwC1cM5TfvMm5/ily9Wj5GN+GBKU2guWLZGoTDoxD7RBf8OLyMFDHq2HS1DBYy4i3i4VGt3td4oZT929qL3XO3APtqNhUYeVDjYIUqmMs06wg==',key_name='tempest-keypair-740147084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40a42527a8b24135b741fe2c38dc14b0',ramdisk_id='',reservation_id='r-uvd0ozk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2097804610',owner_user_name='tempest-TaggedBootDevicesTest-2097804610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e73054ab2cbd425cb182705f0ebfb7a5',uuid=25ee71dc-21c1-4ed4-b3d4-7f8cc107a863,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff5a5c31-e634-489a-b565-418e87aaa11b", "address": "fa:16:3e:42:3a:ef", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5a5c31-e6", "ovs_interfaceid": "ff5a5c31-e634-489a-b565-418e87aaa11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:43:17.823675 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converting VIF {"id": "ff5a5c31-e634-489a-b565-418e87aaa11b", "address": "fa:16:3e:42:3a:ef", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5a5c31-e6", "ovs_interfaceid": "ff5a5c31-e634-489a-b565-418e87aaa11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:17.824162 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:3a:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff5a5c31-e634-489a-b565-418e87aaa11b,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff5a5c31-e6') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:17.824599 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.825009 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:3a:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff5a5c31-e634-489a-b565-418e87aaa11b,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff5a5c31-e6') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:43:17.828759 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08e9aa34-6f8b-5bb5-ab06-bf890e4f1069', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.829570 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.830211 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:17.833002 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: ea0f9737-865a-4199-9077-b64e88af15db] During sync_power_state the instance has a pending task (spawning). Skip. Jun 25 04:43:17.842201 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.843294 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.843470 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.843695 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:43:17.845005 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.845161 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e55b3b0-e38e-5e8a-a766-d702a09a1514', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.845858 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.846504 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:17.859341 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.859817 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.859968 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22b45284-c5, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.860255 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22b45284-c5, col_values=(('qos', UUID('a469b092-c26c-4f7d-80eb-6483c2481110')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.860424 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22b45284-c5, col_values=(('external_ids', {'iface-id': '22b45284-c52f-466b-a2e1-f273384c1dbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:32:46', 'vm-uuid': '7671d823-fb04-46c9-80d9-e171d8032199'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.861220 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.862508 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:17.877021 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.878547 np0000003587 nova-compute[98952]: INFO os_vif [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:32:46,bridge_name='br-int',has_traffic_filtering=True,id=22b45284-c52f-466b-a2e1-f273384c1dbc,network=Network(d59f1de2-a0fd-4318-9724-66a1bbe8ec86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b45284-c5') Jun 25 04:43:17.879747 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.879916 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff5a5c31-e6, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.880179 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff5a5c31-e6, col_values=(('qos', UUID('281e3f54-d688-4b1d-a515-770d69c8c6c8')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.880307 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff5a5c31-e6, col_values=(('external_ids', {'iface-id': 'ff5a5c31-e634-489a-b565-418e87aaa11b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:3a:ef', 'vm-uuid': '25ee71dc-21c1-4ed4-b3d4-7f8cc107a863'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.881146 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.882224 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:17.901619 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.902596 np0000003587 nova-compute[98952]: INFO os_vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:3a:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff5a5c31-e634-489a-b565-418e87aaa11b,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff5a5c31-e6') Jun 25 04:43:17.903373 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-537495923',id=12,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTa58cRFRWbbTonGFe1bcwC1cM5TfvMm5/ily9Wj5GN+GBKU2guWLZGoTDoxD7RBf8OLyMFDHq2HS1DBYy4i3i4VGt3td4oZT929qL3XO3APtqNhUYeVDjYIUqmMs06wg==',key_name='tempest-keypair-740147084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40a42527a8b24135b741fe2c38dc14b0',ramdisk_id='',reservation_id='r-uvd0ozk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2097804610',owner_user_name='tempest-TaggedBootDevicesTest-2097804610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e73054ab2cbd425cb182705f0ebfb7a5',uuid=25ee71dc-21c1-4ed4-b3d4-7f8cc107a863,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7d7f523-bf9e-4f8f-881d-9d05c514eb54", "address": "fa:16:3e:e8:ba:ea", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d7f523-bf", "ovs_interfaceid": "a7d7f523-bf9e-4f8f-881d-9d05c514eb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:43:17.904159 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converting VIF {"id": "a7d7f523-bf9e-4f8f-881d-9d05c514eb54", "address": "fa:16:3e:e8:ba:ea", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d7f523-bf", "ovs_interfaceid": "a7d7f523-bf9e-4f8f-881d-9d05c514eb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:17.904159 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ba:ea,bridge_name='br-int',has_traffic_filtering=True,id=a7d7f523-bf9e-4f8f-881d-9d05c514eb54,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d7f523-bf') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:17.904355 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ba:ea,bridge_name='br-int',has_traffic_filtering=True,id=a7d7f523-bf9e-4f8f-881d-9d05c514eb54,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d7f523-bf') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:43:17.904591 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.906845 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.906845 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:43:17.906845 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.906845 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b72797b-781b-5bae-8ccd-d547ef480a46', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.907339 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.908010 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:17.935245 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.938281 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.938281 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7d7f523-bf, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.938281 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7d7f523-bf, col_values=(('qos', UUID('09e9fdd1-fe4d-47db-bcc4-3de998685abe')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.938690 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7d7f523-bf, col_values=(('external_ids', {'iface-id': 'a7d7f523-bf9e-4f8f-881d-9d05c514eb54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:ba:ea', 'vm-uuid': '25ee71dc-21c1-4ed4-b3d4-7f8cc107a863'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.939509 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.942007 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:17.970584 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.971700 np0000003587 nova-compute[98952]: INFO os_vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ba:ea,bridge_name='br-int',has_traffic_filtering=True,id=a7d7f523-bf9e-4f8f-881d-9d05c514eb54,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d7f523-bf') Jun 25 04:43:17.971879 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-537495923',id=12,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTa58cRFRWbbTonGFe1bcwC1cM5TfvMm5/ily9Wj5GN+GBKU2guWLZGoTDoxD7RBf8OLyMFDHq2HS1DBYy4i3i4VGt3td4oZT929qL3XO3APtqNhUYeVDjYIUqmMs06wg==',key_name='tempest-keypair-740147084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40a42527a8b24135b741fe2c38dc14b0',ramdisk_id='',reservation_id='r-uvd0ozk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2097804610',owner_user_name='tempest-TaggedBootDevicesTest-2097804610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e73054ab2cbd425cb182705f0ebfb7a5',uuid=25ee71dc-21c1-4ed4-b3d4-7f8cc107a863,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed1393f8-f25b-489d-9635-82b920d33137", "address": "fa:16:3e:a7:57:df", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped1393f8-f2", "ovs_interfaceid": "ed1393f8-f25b-489d-9635-82b920d33137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:43:17.972147 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converting VIF {"id": "ed1393f8-f25b-489d-9635-82b920d33137", "address": "fa:16:3e:a7:57:df", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped1393f8-f2", "ovs_interfaceid": "ed1393f8-f25b-489d-9635-82b920d33137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:17.972773 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:57:df,bridge_name='br-int',has_traffic_filtering=True,id=ed1393f8-f25b-489d-9635-82b920d33137,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped1393f8-f2') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:17.973205 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:57:df,bridge_name='br-int',has_traffic_filtering=True,id=ed1393f8-f25b-489d-9635-82b920d33137,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped1393f8-f2') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:43:17.974892 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.974892 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.974892 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:43:17.975819 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.976025 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '53823600-a187-52a8-a9ee-5435469d064e', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:17.976902 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:17.977627 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:18.006863 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:18.009851 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:18.009851 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped1393f8-f2, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:18.010194 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped1393f8-f2, col_values=(('qos', UUID('bb9de9ce-1d40-4434-9a9c-e58a4c9ac832')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:18.010421 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped1393f8-f2, col_values=(('external_ids', {'iface-id': 'ed1393f8-f25b-489d-9635-82b920d33137', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:57:df', 'vm-uuid': '25ee71dc-21c1-4ed4-b3d4-7f8cc107a863'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:18.011609 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:18.013269 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:18.039190 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:18.040576 np0000003587 nova-compute[98952]: INFO os_vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:57:df,bridge_name='br-int',has_traffic_filtering=True,id=ed1393f8-f25b-489d-9635-82b920d33137,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped1393f8-f2') Jun 25 04:43:18.041369 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-537495923',id=12,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTa58cRFRWbbTonGFe1bcwC1cM5TfvMm5/ily9Wj5GN+GBKU2guWLZGoTDoxD7RBf8OLyMFDHq2HS1DBYy4i3i4VGt3td4oZT929qL3XO3APtqNhUYeVDjYIUqmMs06wg==',key_name='tempest-keypair-740147084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40a42527a8b24135b741fe2c38dc14b0',ramdisk_id='',reservation_id='r-uvd0ozk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2097804610',owner_user_name='tempest-TaggedBootDevicesTest-2097804610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e73054ab2cbd425cb182705f0ebfb7a5',uuid=25ee71dc-21c1-4ed4-b3d4-7f8cc107a863,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2af2f66c-7de8-49e4-badd-16d0764caff6", "address": "fa:16:3e:fa:99:7d", "network": {"id": "dbbc0276-7726-40fd-b3ee-f5a7887f5e72", "bridge": "br-int", "label": "tempest-device-tagging-net2-1967790487", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af2f66c-7d", "ovs_interfaceid": "2af2f66c-7de8-49e4-badd-16d0764caff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:43:18.041742 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converting VIF {"id": "2af2f66c-7de8-49e4-badd-16d0764caff6", "address": "fa:16:3e:fa:99:7d", "network": {"id": "dbbc0276-7726-40fd-b3ee-f5a7887f5e72", "bridge": "br-int", "label": "tempest-device-tagging-net2-1967790487", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af2f66c-7d", "ovs_interfaceid": "2af2f66c-7de8-49e4-badd-16d0764caff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:18.044595 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:99:7d,bridge_name='br-int',has_traffic_filtering=True,id=2af2f66c-7de8-49e4-badd-16d0764caff6,network=Network(dbbc0276-7726-40fd-b3ee-f5a7887f5e72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2af2f66c-7d') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:18.044595 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:99:7d,bridge_name='br-int',has_traffic_filtering=True,id=2af2f66c-7de8-49e4-badd-16d0764caff6,network=Network(dbbc0276-7726-40fd-b3ee-f5a7887f5e72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2af2f66c-7d') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:43:18.044595 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:18.044595 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:18.044595 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:43:18.045412 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:18.045670 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1fd8bd6e-c38d-5af5-8d70-c302928cc5de', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:18.046527 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:18.047225 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:18.078763 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:18.082528 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:18.082528 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2af2f66c-7d, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:18.082819 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2af2f66c-7d, col_values=(('qos', UUID('e815ba74-e17c-401e-b65a-d74d07e6431e')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:18.082969 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2af2f66c-7d, col_values=(('external_ids', {'iface-id': '2af2f66c-7de8-49e4-badd-16d0764caff6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:99:7d', 'vm-uuid': '25ee71dc-21c1-4ed4-b3d4-7f8cc107a863'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:18.085321 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:18.086474 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:18.106703 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:43:18.108335 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:43:18.108634 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:18.108814 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:18.126954 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:18.128392 np0000003587 nova-compute[98952]: INFO os_vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:99:7d,bridge_name='br-int',has_traffic_filtering=True,id=2af2f66c-7de8-49e4-badd-16d0764caff6,network=Network(dbbc0276-7726-40fd-b3ee-f5a7887f5e72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2af2f66c-7d') Jun 25 04:43:18.131188 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-537495923',id=12,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTa58cRFRWbbTonGFe1bcwC1cM5TfvMm5/ily9Wj5GN+GBKU2guWLZGoTDoxD7RBf8OLyMFDHq2HS1DBYy4i3i4VGt3td4oZT929qL3XO3APtqNhUYeVDjYIUqmMs06wg==',key_name='tempest-keypair-740147084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40a42527a8b24135b741fe2c38dc14b0',ramdisk_id='',reservation_id='r-uvd0ozk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2097804610',owner_user_name='tempest-TaggedBootDevicesTest-2097804610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:42:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e73054ab2cbd425cb182705f0ebfb7a5',uuid=25ee71dc-21c1-4ed4-b3d4-7f8cc107a863,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07a46cd4-912b-4863-8b8f-f345fe260bd0", "address": "fa:16:3e:95:90:8b", "network": {"id": "dbbc0276-7726-40fd-b3ee-f5a7887f5e72", "bridge": "br-int", "label": "tempest-device-tagging-net2-1967790487", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a46cd4-91", "ovs_interfaceid": "07a46cd4-912b-4863-8b8f-f345fe260bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:43:18.131188 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converting VIF {"id": "07a46cd4-912b-4863-8b8f-f345fe260bd0", "address": "fa:16:3e:95:90:8b", "network": {"id": "dbbc0276-7726-40fd-b3ee-f5a7887f5e72", "bridge": "br-int", "label": "tempest-device-tagging-net2-1967790487", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a46cd4-91", "ovs_interfaceid": "07a46cd4-912b-4863-8b8f-f345fe260bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:18.131188 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=07a46cd4-912b-4863-8b8f-f345fe260bd0,network=Network(dbbc0276-7726-40fd-b3ee-f5a7887f5e72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a46cd4-91') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:18.131188 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=07a46cd4-912b-4863-8b8f-f345fe260bd0,network=Network(dbbc0276-7726-40fd-b3ee-f5a7887f5e72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a46cd4-91') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:43:18.131188 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:18.131188 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:18.131188 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:43:18.132624 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:18.132813 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '336beb5e-fc70-5a06-b073-5ed50edfa4e1', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:18.133762 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:18.135009 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:18.166632 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:18.170205 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:18.170463 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07a46cd4-91, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:18.170876 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap07a46cd4-91, col_values=(('qos', UUID('a3ee89b1-f329-45b8-b66b-58048f174ed7')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:18.171030 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap07a46cd4-91, col_values=(('external_ids', {'iface-id': '07a46cd4-912b-4863-8b8f-f345fe260bd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:90:8b', 'vm-uuid': '25ee71dc-21c1-4ed4-b3d4-7f8cc107a863'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:18.172914 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:18.175140 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:18.201845 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '185eb95c254e401a850b00b6968ac365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23cc8f804d4d43ca988183143f7c55ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:43:18.215574 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:18.216992 np0000003587 nova-compute[98952]: INFO os_vif [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=07a46cd4-912b-4863-8b8f-f345fe260bd0,network=Network(dbbc0276-7726-40fd-b3ee-f5a7887f5e72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a46cd4-91') Jun 25 04:43:18.612871 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 25 04:43:18.639006 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:43:18.642449 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.50.100 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:43:18.658827 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.40.100 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:43:18.662053 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:18.676254 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:18.683347 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:18.700813 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:18.700813 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:18.700813 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:18.700813 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:18.700813 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:18.700813 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:18.700813 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:18.700813 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:18.700813 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:18.700813 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:18.700813 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:18.700813 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:18.700813 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:18.700813 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:18.700813 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:18.700813 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:18.700813 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:43:18.704511 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:18.704511 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:18.704511 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:18.704511 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:18.704511 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:18.704511 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:18.704511 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:18.704511 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:18.704511 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:18.704511 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:18.704511 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:18.704511 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:18.704511 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:18.704511 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:18.704511 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:18.704511 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:18.704511 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:43:18.709491 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:18.709491 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:18.709491 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:18.709491 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:18.709491 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:18.709491 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:18.709491 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:18.709491 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:18.709491 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:18.709491 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:18.709491 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:18.709491 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:18.709491 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:18.709491 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:18.709491 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:18.709491 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:18.709491 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:43:18.711917 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:18.711917 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:18.711917 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:18.711917 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:18.711917 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:18.711917 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:18.711917 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:18.711917 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:18.711917 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:18.711917 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:18.711917 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:18.711917 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:18.711917 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:18.711917 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:18.711917 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:18.711917 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:18.711917 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:43:18.785461 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d, portal: 192.168.50.100,3260] Jun 25 04:43:18.785461 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d, portal: 192.168.50.100,3260] successful. Jun 25 04:43:18.785461 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:18.799249 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:18.804786 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Successfully created port: 32349050-a5cd-4950-b24a-c8c426cfbf07 {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:43:18.808599 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d, portal: 192.168.40.100,3260] Jun 25 04:43:18.808599 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d, portal: 192.168.40.100,3260] successful. Jun 25 04:43:18.808599 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:18.825035 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:18.833189 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:43:18.834698 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.223s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:43:18.834698 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Connected to 192.168.50.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:43:18.835786 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] HCTL ('23', '-', '-', 0) found on session 25 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:43:18.835949 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Scanning host 23 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:18.859958 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:43:18.861910 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.251s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:43:18.861910 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Connected to 192.168.40.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:43:18.867178 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] HCTL ('24', '-', '-', 0) found on session 26 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:43:18.867411 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Scanning host 24 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:43:18.870028 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Searching for a device in session 25 and hctl ['23', '*', '*', 0] yield: sdr {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:43:18.870028 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Connected to sdr using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:43:18.886983 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Searching for a device in session 26 and hctl ['24', '*', '*', 0] yield: sds {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:43:18.887386 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Connected to sds using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:43:19.117807 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Start building block device mappings for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 25 04:43:19.398328 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:43:19.400141 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:43:19.400141 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] No VIF found with MAC fa:16:3e:98:32:46, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:43:19.400141 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Using config drive Jun 25 04:43:19.537385 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Successfully updated port: 32349050-a5cd-4950-b24a-c8c426cfbf07 {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:43:19.610843 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 25 04:43:19.634900 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-40dff855-24af-41d5-b3d8-b3a237f6ab80 req-cb4b597b-4283-4e22-98d5-16975a317148 service nova] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Received event network-changed-32349050-a5cd-4950-b24a-c8c426cfbf07 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:19.635437 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-40dff855-24af-41d5-b3d8-b3a237f6ab80 req-cb4b597b-4283-4e22-98d5-16975a317148 service nova] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Refreshing instance network info cache due to event network-changed-32349050-a5cd-4950-b24a-c8c426cfbf07. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:43:19.635665 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-40dff855-24af-41d5-b3d8-b3a237f6ab80 req-cb4b597b-4283-4e22-98d5-16975a317148 service nova] Acquiring lock "refresh_cache-097ff869-4376-4450-9a31-5389fe5e44c8" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:43:19.635774 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-40dff855-24af-41d5-b3d8-b3a237f6ab80 req-cb4b597b-4283-4e22-98d5-16975a317148 service nova] Acquired lock "refresh_cache-097ff869-4376-4450-9a31-5389fe5e44c8" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:43:19.635913 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-40dff855-24af-41d5-b3d8-b3a237f6ab80 req-cb4b597b-4283-4e22-98d5-16975a317148 service nova] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Refreshing network info cache for port 32349050-a5cd-4950-b24a-c8c426cfbf07 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:43:19.656428 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:19.744878 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:43:19.745208 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:43:19.745405 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] No VIF found with MAC fa:16:3e:cc:30:bf, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:43:19.745790 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] No VIF found with MAC fa:16:3e:a7:57:df, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:43:19.746547 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Using config drive Jun 25 04:43:19.878118 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:19.905824 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:20.045811 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Acquiring lock "refresh_cache-097ff869-4376-4450-9a31-5389fe5e44c8" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:43:20.060486 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Creating config drive at /opt/stack/data/nova/instances/7671d823-fb04-46c9-80d9-e171d8032199/disk.config Jun 25 04:43:20.063726 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7671d823-fb04-46c9-80d9-e171d8032199/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjo4k4l3w {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:20.121642 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7671d823-fb04-46c9-80d9-e171d8032199/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjo4k4l3w" returned: 0 in 0.057s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:20.129310 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Start spawning the instance on the hypervisor. {{(pid=98952) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 25 04:43:20.130824 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Creating instance directory {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 25 04:43:20.131105 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Creating image(s) Jun 25 04:43:20.131742 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Acquiring lock "/opt/stack/data/nova/instances/097ff869-4376-4450-9a31-5389fe5e44c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:20.131988 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "/opt/stack/data/nova/instances/097ff869-4376-4450-9a31-5389fe5e44c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:20.132569 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "/opt/stack/data/nova/instances/097ff869-4376-4450-9a31-5389fe5e44c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:20.133356 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:20.137440 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:20.139137 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-40dff855-24af-41d5-b3d8-b3a237f6ab80 req-cb4b597b-4283-4e22-98d5-16975a317148 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:20.141673 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:20.229928 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-40dff855-24af-41d5-b3d8-b3a237f6ab80 req-cb4b597b-4283-4e22-98d5-16975a317148 service nova] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:43:20.239758 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.098s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:20.240199 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Acquiring lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:20.240719 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:20.241199 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:20.243915 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:20.244418 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:20.280222 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:20.343168 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.097s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:20.349307 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/097ff869-4376-4450-9a31-5389fe5e44c8/disk 1073741824 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:20.411957 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/097ff869-4376-4450-9a31-5389fe5e44c8/disk 1073741824" returned: 0 in 0.063s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:20.412902 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.172s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:20.413047 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:20.441840 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-40dff855-24af-41d5-b3d8-b3a237f6ab80 req-cb4b597b-4283-4e22-98d5-16975a317148 service nova] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:20.497300 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Creating config drive at /opt/stack/data/nova/instances/25ee71dc-21c1-4ed4-b3d4-7f8cc107a863/disk.config Jun 25 04:43:20.498539 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.085s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:20.499723 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Checking if we can resize image /opt/stack/data/nova/instances/097ff869-4376-4450-9a31-5389fe5e44c8/disk. size=1073741824 {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 25 04:43:20.500358 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/097ff869-4376-4450-9a31-5389fe5e44c8/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:20.522097 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/25ee71dc-21c1-4ed4-b3d4-7f8cc107a863/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6hz0ouqs {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:20.580748 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/25ee71dc-21c1-4ed4-b3d4-7f8cc107a863/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6hz0ouqs" returned: 0 in 0.059s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:20.612429 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/097ff869-4376-4450-9a31-5389fe5e44c8/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:20.613111 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Cannot resize image /opt/stack/data/nova/instances/097ff869-4376-4450-9a31-5389fe5e44c8/disk to a smaller size. {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 25 04:43:20.613639 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Created local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 25 04:43:20.614152 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Ensure instance console log exists: /opt/stack/data/nova/instances/097ff869-4376-4450-9a31-5389fe5e44c8/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:43:20.614931 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:20.614931 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:20.615255 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:20.630655 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Found WWN 330000000908985c8 for multipath device dm-14 {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 25 04:43:20.631716 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:43:20.631955 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] <== connect_volume: return (3043ms) {'type': 'block', 'scsi_wwn': '330000000908985c8', 'path': '/dev/dm-14', 'multipath_id': '330000000908985c8'} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:43:20.632120 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000908985c8', 'path': '/dev/dm-14', 'multipath_id': '330000000908985c8'} {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 25 04:43:20.704058 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:20.771900 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:20.776861 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:20.921892 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:20.951045 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-40dff855-24af-41d5-b3d8-b3a237f6ab80 req-cb4b597b-4283-4e22-98d5-16975a317148 service nova] Releasing lock "refresh_cache-097ff869-4376-4450-9a31-5389fe5e44c8" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:43:20.951045 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Acquired lock "refresh_cache-097ff869-4376-4450-9a31-5389fe5e44c8" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:43:20.951737 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:43:21.022094 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-676c0849-34a3-40c2-bc4b-8aca2df11eb5 req-b2073288-7112-4b3a-b6c2-8cd73ff22e1e service nova] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Received event network-vif-plugged-22b45284-c52f-466b-a2e1-f273384c1dbc {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:21.023094 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-676c0849-34a3-40c2-bc4b-8aca2df11eb5 req-b2073288-7112-4b3a-b6c2-8cd73ff22e1e service nova] Acquiring lock "7671d823-fb04-46c9-80d9-e171d8032199-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:21.023270 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-676c0849-34a3-40c2-bc4b-8aca2df11eb5 req-b2073288-7112-4b3a-b6c2-8cd73ff22e1e service nova] Lock "7671d823-fb04-46c9-80d9-e171d8032199-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:21.023419 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-676c0849-34a3-40c2-bc4b-8aca2df11eb5 req-b2073288-7112-4b3a-b6c2-8cd73ff22e1e service nova] Lock "7671d823-fb04-46c9-80d9-e171d8032199-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:21.023534 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-676c0849-34a3-40c2-bc4b-8aca2df11eb5 req-b2073288-7112-4b3a-b6c2-8cd73ff22e1e service nova] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Processing event network-vif-plugged-22b45284-c52f-466b-a2e1-f273384c1dbc {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:43:21.122196 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:21.148221 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:43:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1478758735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-serverbootfromvolumestablerescuetest-server-1478758735',id=14,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5d52ed3b8de460eb65a8fb4ad1b015d',ramdisk_id='',reservation_id='r-rdate591',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-6878904',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:43:11Z,user_data=None,user_id='27ebe4b23b624995a52b9313ff9e318a',uuid=df96228c-c3b2-457d-9eb1-2e82186076f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "address": "fa:16:3e:e9:03:29", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5c445e-b1", "ovs_interfaceid": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:43:21.148221 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converting VIF {"id": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "address": "fa:16:3e:e9:03:29", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5c445e-b1", "ovs_interfaceid": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:21.152485 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:03:29,bridge_name='br-int',has_traffic_filtering=True,id=2a5c445e-b115-42f3-984d-bfe5af6670e4,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5c445e-b1') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:21.155526 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'pci_devices' on Instance uuid df96228c-c3b2-457d-9eb1-2e82186076f4 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:43:21.171197 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:21.252806 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:21.402115 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:21.485054 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:21.489144 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:21.546215 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:21.584098 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:21.602140 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] End _get_guest_xml xml= Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: df96228c-c3b2-457d-9eb1-2e82186076f4 Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: instance-0000000e Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: 196608 Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: tempest-ServerBootFromVolumeStableRescueTest-server-1478758735 Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: 2026-06-25 04:43:17 Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: 192 Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: True Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: bare Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: virtio Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: tempest-ServerBootFromVolumeStableRescueTest-6878904 Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: df96228c-c3b2-457d-9eb1-2e82186076f4 Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: df96228c-c3b2-457d-9eb1-2e82186076f4 Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: hvm Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: 128 Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: 31e8293d-50f2-4271-8cc5-bdd52f895f6d Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Preparing to wait for external event network-vif-plugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:43:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1478758735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-serverbootfromvolumestablerescuetest-server-1478758735',id=14,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5d52ed3b8de460eb65a8fb4ad1b015d',ramdisk_id='',reservation_id='r-rdate591',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-6878904',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:43:11Z,user_data=None,user_id='27ebe4b23b624995a52b9313ff9e318a',uuid=df96228c-c3b2-457d-9eb1-2e82186076f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "address": "fa:16:3e:e9:03:29", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5c445e-b1", "ovs_interfaceid": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converting VIF {"id": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "address": "fa:16:3e:e9:03:29", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5c445e-b1", "ovs_interfaceid": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:21.662624 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:03:29,bridge_name='br-int',has_traffic_filtering=True,id=2a5c445e-b115-42f3-984d-bfe5af6670e4,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5c445e-b1') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:21.666303 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:03:29,bridge_name='br-int',has_traffic_filtering=True,id=2a5c445e-b115-42f3-984d-bfe5af6670e4,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5c445e-b1') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:43:21.670592 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:21.670592 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:21.670866 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:43:21.673762 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:21.673920 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ae0f933-48a3-5b4a-bbd3-f6844cdedb66', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:21.676175 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:21.686123 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:21.694640 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:21.727145 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:21.736356 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:21.736356 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a5c445e-b1, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:21.736356 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a5c445e-b1, col_values=(('qos', UUID('dce5fa2f-dd95-4ad2-817a-f7c522baaf15')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:21.736356 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a5c445e-b1, col_values=(('external_ids', {'iface-id': '2a5c445e-b115-42f3-984d-bfe5af6670e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:03:29', 'vm-uuid': 'df96228c-c3b2-457d-9eb1-2e82186076f4'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:21.737814 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:21.738745 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:21.758100 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:21.765144 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:21.823575 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:21.823575 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:21.824397 np0000003587 nova-compute[98952]: INFO os_vif [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:03:29,bridge_name='br-int',has_traffic_filtering=True,id=2a5c445e-b115-42f3-984d-bfe5af6670e4,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5c445e-b1') Jun 25 04:43:21.890017 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:21.893001 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:21.899372 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:21.952134 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:21.964039 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:22.008806 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:22.014590 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:22.039820 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:22.063456 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:22.130088 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:22.221200 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:22.243192 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:22.329103 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Updating instance_info_cache with network_info: [{"id": "32349050-a5cd-4950-b24a-c8c426cfbf07", "address": "fa:16:3e:cc:df:5a", "network": {"id": "8a0f3d27-84d3-4110-8c2e-a1fe33eef085", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1913090721-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23cc8f804d4d43ca988183143f7c55ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32349050-a5", "ovs_interfaceid": "32349050-a5cd-4950-b24a-c8c426cfbf07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:22.381506 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:22.395737 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:22.409671 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:22.450732 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:22.537373 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:22.659522 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:22.667482 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:22.673605 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:22.683522 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-89eb9c72-2fe3-424a-88fe-1bd51cc7eb8a req-b458a234-9c71-433e-beb5-f9b74b6e1c49 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-plugged-2af2f66c-7de8-49e4-badd-16d0764caff6 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:22.683715 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-89eb9c72-2fe3-424a-88fe-1bd51cc7eb8a req-b458a234-9c71-433e-beb5-f9b74b6e1c49 service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:22.683841 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-89eb9c72-2fe3-424a-88fe-1bd51cc7eb8a req-b458a234-9c71-433e-beb5-f9b74b6e1c49 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:22.686343 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-89eb9c72-2fe3-424a-88fe-1bd51cc7eb8a req-b458a234-9c71-433e-beb5-f9b74b6e1c49 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:22.686343 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-89eb9c72-2fe3-424a-88fe-1bd51cc7eb8a req-b458a234-9c71-433e-beb5-f9b74b6e1c49 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Processing event network-vif-plugged-2af2f66c-7de8-49e4-badd-16d0764caff6 {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:43:22.702236 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:22.704706 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:43:22.705092 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:22.705283 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] VM Started (Lifecycle Event) Jun 25 04:43:22.707858 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Guest created on hypervisor {{(pid=98952) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 25 04:43:22.710836 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:22.715453 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Instance spawned successfully. Jun 25 04:43:22.715593 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 25 04:43:22.835764 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Releasing lock "refresh_cache-097ff869-4376-4450-9a31-5389fe5e44c8" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:43:22.836248 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Instance network_info: |[{"id": "32349050-a5cd-4950-b24a-c8c426cfbf07", "address": "fa:16:3e:cc:df:5a", "network": {"id": "8a0f3d27-84d3-4110-8c2e-a1fe33eef085", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1913090721-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23cc8f804d4d43ca988183143f7c55ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32349050-a5", "ovs_interfaceid": "32349050-a5cd-4950-b24a-c8c426cfbf07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 25 04:43:22.838990 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Start _get_guest_xml network_info=[{"id": "32349050-a5cd-4950-b24a-c8c426cfbf07", "address": "fa:16:3e:cc:df:5a", "network": {"id": "8a0f3d27-84d3-4110-8c2e-a1fe33eef085", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1913090721-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23cc8f804d4d43ca988183143f7c55ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32349050-a5", "ovs_interfaceid": "32349050-a5cd-4950-b24a-c8c426cfbf07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '4ecaf199-c1b9-4ce3-869c-178c170c1662'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:43:22.852253 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:43:22.854356 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='tempest-DeleteServersTestJSON-server-727501721', uuid='097ff869-4376-4450-9a31-5389fe5e44c8'), owner=OwnerMeta(userid='185eb95c254e401a850b00b6968ac365', username='tempest-DeleteServersTestJSON-91450344-project-member', projectid='23cc8f804d4d43ca988183143f7c55ac', projectname='tempest-DeleteServersTestJSON-91450344'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "32349050-a5cd-4950-b24a-c8c426cfbf07", "address": "fa:16:3e:cc:df:5a", "network": {"id": "8a0f3d27-84d3-4110-8c2e-a1fe33eef085", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1913090721-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23cc8f804d4d43ca988183143f7c55ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32349050-a5", "ovs_interfaceid": "32349050-a5cd-4950-b24a-c8c426cfbf07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362602.853548) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:43:22.855729 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:43:22.856072 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:43:22.858697 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:43:22.859933 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:43:22.860598 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:43:22.861055 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:43:22.861055 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:43:22.862716 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:43:22.862716 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:43:22.862716 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:43:22.862716 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:43:22.865493 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:43:22.866596 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:43:22.866596 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:43:22.867755 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:43:22.870588 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:43:22.898367 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:43:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-727501721',display_name='tempest-DeleteServersTestJSON-server-727501721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-deleteserverstestjson-server-727501721',id=16,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23cc8f804d4d43ca988183143f7c55ac',ramdisk_id='',reservation_id='r-uf80zpa0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-91450344',owner_user_name='tempest-DeleteServersTestJSON-91450344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:43:19Z,user_data=None,user_id='185eb95c254e401a850b00b6968ac365',uuid=097ff869-4376-4450-9a31-5389fe5e44c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32349050-a5cd-4950-b24a-c8c426cfbf07", "address": "fa:16:3e:cc:df:5a", "network": {"id": "8a0f3d27-84d3-4110-8c2e-a1fe33eef085", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1913090721-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23cc8f804d4d43ca988183143f7c55ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32349050-a5", "ovs_interfaceid": "32349050-a5cd-4950-b24a-c8c426cfbf07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:43:22.898367 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Converting VIF {"id": "32349050-a5cd-4950-b24a-c8c426cfbf07", "address": "fa:16:3e:cc:df:5a", "network": {"id": "8a0f3d27-84d3-4110-8c2e-a1fe33eef085", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1913090721-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23cc8f804d4d43ca988183143f7c55ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32349050-a5", "ovs_interfaceid": "32349050-a5cd-4950-b24a-c8c426cfbf07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:22.899302 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:df:5a,bridge_name='br-int',has_traffic_filtering=True,id=32349050-a5cd-4950-b24a-c8c426cfbf07,network=Network(8a0f3d27-84d3-4110-8c2e-a1fe33eef085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32349050-a5') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:22.899877 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lazy-loading 'pci_devices' on Instance uuid 097ff869-4376-4450-9a31-5389fe5e44c8 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:43:23.062100 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:23.071383 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:23.159734 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-294c0f20-dbe1-446d-8c28-83f66be250c3 req-2d7b6c96-3659-4964-9cd1-f94eb428e030 service nova] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Received event network-vif-plugged-22b45284-c52f-466b-a2e1-f273384c1dbc {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:23.164004 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-294c0f20-dbe1-446d-8c28-83f66be250c3 req-2d7b6c96-3659-4964-9cd1-f94eb428e030 service nova] Acquiring lock "7671d823-fb04-46c9-80d9-e171d8032199-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:23.164004 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-294c0f20-dbe1-446d-8c28-83f66be250c3 req-2d7b6c96-3659-4964-9cd1-f94eb428e030 service nova] Lock "7671d823-fb04-46c9-80d9-e171d8032199-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:23.164004 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-294c0f20-dbe1-446d-8c28-83f66be250c3 req-2d7b6c96-3659-4964-9cd1-f94eb428e030 service nova] Lock "7671d823-fb04-46c9-80d9-e171d8032199-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:23.164004 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-294c0f20-dbe1-446d-8c28-83f66be250c3 req-2d7b6c96-3659-4964-9cd1-f94eb428e030 service nova] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] No waiting events found dispatching network-vif-plugged-22b45284-c52f-466b-a2e1-f273384c1dbc {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:43:23.164004 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-294c0f20-dbe1-446d-8c28-83f66be250c3 req-2d7b6c96-3659-4964-9cd1-f94eb428e030 service nova] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Received unexpected event network-vif-plugged-22b45284-c52f-466b-a2e1-f273384c1dbc for instance with vm_state building and task_state spawning. Jun 25 04:43:23.164004 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-294c0f20-dbe1-446d-8c28-83f66be250c3 req-2d7b6c96-3659-4964-9cd1-f94eb428e030 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-plugged-22fd01da-9056-4cd0-8489-c9f005bb66a5 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:23.164004 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-294c0f20-dbe1-446d-8c28-83f66be250c3 req-2d7b6c96-3659-4964-9cd1-f94eb428e030 service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:23.164004 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-294c0f20-dbe1-446d-8c28-83f66be250c3 req-2d7b6c96-3659-4964-9cd1-f94eb428e030 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:23.164004 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-294c0f20-dbe1-446d-8c28-83f66be250c3 req-2d7b6c96-3659-4964-9cd1-f94eb428e030 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:23.164004 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-294c0f20-dbe1-446d-8c28-83f66be250c3 req-2d7b6c96-3659-4964-9cd1-f94eb428e030 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Processing event network-vif-plugged-22fd01da-9056-4cd0-8489-c9f005bb66a5 {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:43:23.164004 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-294c0f20-dbe1-446d-8c28-83f66be250c3 req-2d7b6c96-3659-4964-9cd1-f94eb428e030 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-plugged-22fd01da-9056-4cd0-8489-c9f005bb66a5 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:23.164004 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-294c0f20-dbe1-446d-8c28-83f66be250c3 req-2d7b6c96-3659-4964-9cd1-f94eb428e030 service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:23.164004 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-294c0f20-dbe1-446d-8c28-83f66be250c3 req-2d7b6c96-3659-4964-9cd1-f94eb428e030 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:23.164004 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-294c0f20-dbe1-446d-8c28-83f66be250c3 req-2d7b6c96-3659-4964-9cd1-f94eb428e030 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:23.164004 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-294c0f20-dbe1-446d-8c28-83f66be250c3 req-2d7b6c96-3659-4964-9cd1-f94eb428e030 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] No event matching network-vif-plugged-22fd01da-9056-4cd0-8489-c9f005bb66a5 in dict_keys([('network-vif-plugged', 'a36eb1f7-4779-4078-a224-bc487abd01a6'), ('network-vif-plugged', 'ff5a5c31-e634-489a-b565-418e87aaa11b'), ('network-vif-plugged', 'a7d7f523-bf9e-4f8f-881d-9d05c514eb54'), ('network-vif-plugged', 'ed1393f8-f25b-489d-9635-82b920d33137'), ('network-vif-plugged', '07a46cd4-912b-4863-8b8f-f345fe260bd0')]) {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 25 04:43:23.164885 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-294c0f20-dbe1-446d-8c28-83f66be250c3 req-2d7b6c96-3659-4964-9cd1-f94eb428e030 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received unexpected event network-vif-plugged-22fd01da-9056-4cd0-8489-c9f005bb66a5 for instance with vm_state building and task_state spawning. Jun 25 04:43:23.164885 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-294c0f20-dbe1-446d-8c28-83f66be250c3 req-2d7b6c96-3659-4964-9cd1-f94eb428e030 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-plugged-a36eb1f7-4779-4078-a224-bc487abd01a6 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:23.164885 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-294c0f20-dbe1-446d-8c28-83f66be250c3 req-2d7b6c96-3659-4964-9cd1-f94eb428e030 service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:23.164885 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-294c0f20-dbe1-446d-8c28-83f66be250c3 req-2d7b6c96-3659-4964-9cd1-f94eb428e030 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:23.164885 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-294c0f20-dbe1-446d-8c28-83f66be250c3 req-2d7b6c96-3659-4964-9cd1-f94eb428e030 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:23.164885 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-294c0f20-dbe1-446d-8c28-83f66be250c3 req-2d7b6c96-3659-4964-9cd1-f94eb428e030 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Processing event network-vif-plugged-a36eb1f7-4779-4078-a224-bc487abd01a6 {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:43:23.214646 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:23.226720 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:43:23.229483 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Found default for hw_cdrom_bus of ide {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:23.229483 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Found default for hw_disk_bus of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:23.229483 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Found default for hw_input_bus of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:23.229483 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Found default for hw_pointer_model of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:23.229483 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Found default for hw_video_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:23.230763 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Found default for hw_vif_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:23.290359 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:23.301379 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:23.397899 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:43:23.397899 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:43:23.398525 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] No VIF found with MAC fa:16:3e:e9:03:29, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:43:23.398525 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Using config drive Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] End _get_guest_xml xml= Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: 097ff869-4376-4450-9a31-5389fe5e44c8 Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: instance-00000010 Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: 196608 Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: tempest-DeleteServersTestJSON-server-727501721 Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: 2026-06-25 04:43:22 Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: 192 Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: True Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: bare Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: virtio Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: tempest-DeleteServersTestJSON-91450344-project-member Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: tempest-DeleteServersTestJSON-91450344 Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: 097ff869-4376-4450-9a31-5389fe5e44c8 Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: 097ff869-4376-4450-9a31-5389fe5e44c8 Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: hvm Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: 128 Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: Jun 25 04:43:23.404383 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:43:23.406715 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Preparing to wait for external event network-vif-plugged-32349050-a5cd-4950-b24a-c8c426cfbf07 {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:43:23.406715 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Acquiring lock "097ff869-4376-4450-9a31-5389fe5e44c8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:23.406715 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "097ff869-4376-4450-9a31-5389fe5e44c8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:23.406715 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "097ff869-4376-4450-9a31-5389fe5e44c8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:23.406715 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:43:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-727501721',display_name='tempest-DeleteServersTestJSON-server-727501721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-deleteserverstestjson-server-727501721',id=16,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23cc8f804d4d43ca988183143f7c55ac',ramdisk_id='',reservation_id='r-uf80zpa0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-91450344',owner_user_name='tempest-DeleteServersTestJSON-91450344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:43:19Z,user_data=None,user_id='185eb95c254e401a850b00b6968ac365',uuid=097ff869-4376-4450-9a31-5389fe5e44c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32349050-a5cd-4950-b24a-c8c426cfbf07", "address": "fa:16:3e:cc:df:5a", "network": {"id": "8a0f3d27-84d3-4110-8c2e-a1fe33eef085", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1913090721-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23cc8f804d4d43ca988183143f7c55ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32349050-a5", "ovs_interfaceid": "32349050-a5cd-4950-b24a-c8c426cfbf07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:43:23.406715 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Converting VIF {"id": "32349050-a5cd-4950-b24a-c8c426cfbf07", "address": "fa:16:3e:cc:df:5a", "network": {"id": "8a0f3d27-84d3-4110-8c2e-a1fe33eef085", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1913090721-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23cc8f804d4d43ca988183143f7c55ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32349050-a5", "ovs_interfaceid": "32349050-a5cd-4950-b24a-c8c426cfbf07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:23.407942 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:df:5a,bridge_name='br-int',has_traffic_filtering=True,id=32349050-a5cd-4950-b24a-c8c426cfbf07,network=Network(8a0f3d27-84d3-4110-8c2e-a1fe33eef085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32349050-a5') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:23.408847 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:df:5a,bridge_name='br-int',has_traffic_filtering=True,id=32349050-a5cd-4950-b24a-c8c426cfbf07,network=Network(8a0f3d27-84d3-4110-8c2e-a1fe33eef085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32349050-a5') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:43:23.409415 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:23.409671 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:23.412626 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:43:23.412626 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:23.412626 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de1f9992-eca5-517f-a5d4-3cd57425b1a7', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:23.417055 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:23.418804 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:23.425446 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:23.429235 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:23.429235 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32349050-a5, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:23.429850 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32349050-a5, col_values=(('qos', UUID('6f2cb9a7-5e68-4865-bef5-57cebfba492a')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:23.430089 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32349050-a5, col_values=(('external_ids', {'iface-id': '32349050-a5cd-4950-b24a-c8c426cfbf07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:df:5a', 'vm-uuid': '097ff869-4376-4450-9a31-5389fe5e44c8'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:23.432548 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:23.434487 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:23.451630 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:23.451630 np0000003587 nova-compute[98952]: INFO os_vif [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:df:5a,bridge_name='br-int',has_traffic_filtering=True,id=32349050-a5cd-4950-b24a-c8c426cfbf07,network=Network(8a0f3d27-84d3-4110-8c2e-a1fe33eef085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32349050-a5') Jun 25 04:43:23.462089 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-fe0c5f45-a42d-4b27-beac-bab9920e8a6e req-67405528-71f3-45eb-9d12-fef118a7d8e9 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-plugged-a7d7f523-bf9e-4f8f-881d-9d05c514eb54 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:23.462089 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-fe0c5f45-a42d-4b27-beac-bab9920e8a6e req-67405528-71f3-45eb-9d12-fef118a7d8e9 service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:23.462089 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-fe0c5f45-a42d-4b27-beac-bab9920e8a6e req-67405528-71f3-45eb-9d12-fef118a7d8e9 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:23.462089 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-fe0c5f45-a42d-4b27-beac-bab9920e8a6e req-67405528-71f3-45eb-9d12-fef118a7d8e9 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:23.462089 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-fe0c5f45-a42d-4b27-beac-bab9920e8a6e req-67405528-71f3-45eb-9d12-fef118a7d8e9 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Processing event network-vif-plugged-a7d7f523-bf9e-4f8f-881d-9d05c514eb54 {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:43:23.535464 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:23.549684 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:23.733779 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] During sync_power_state the instance has a pending task (spawning). Skip. Jun 25 04:43:23.733779 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Paused> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:23.734934 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] VM Paused (Lifecycle Event) Jun 25 04:43:23.742668 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Took 8.80 seconds to spawn the instance on the hypervisor. Jun 25 04:43:23.742668 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:23.907650 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:24.000239 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:24.032352 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:24.032352 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:24.071888 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:24.086989 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:24.146048 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Creating config drive at /opt/stack/data/nova/instances/df96228c-c3b2-457d-9eb1-2e82186076f4/disk.config Jun 25 04:43:24.154458 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/df96228c-c3b2-457d-9eb1-2e82186076f4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpso6dcr0x {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:24.210397 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/df96228c-c3b2-457d-9eb1-2e82186076f4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpso6dcr0x" returned: 0 in 0.055s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:24.238113 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:24.244338 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:24.244652 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] VM Resumed (Lifecycle Event) Jun 25 04:43:24.267566 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Took 17.90 seconds to build instance. Jun 25 04:43:24.409278 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:24.427485 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:24.641115 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:24.750082 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:24.755272 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:43:24.770575 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ca04f3b5-0982-4d0e-8694-7e7173e6681a tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "7671d823-fb04-46c9-80d9-e171d8032199" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 19.406s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:24.795351 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-a24f4a72-1b1d-44c5-b8b8-69952e9f3e14 req-63fdb638-2435-4394-9625-9185c492963a service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-plugged-2af2f66c-7de8-49e4-badd-16d0764caff6 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:24.795613 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a24f4a72-1b1d-44c5-b8b8-69952e9f3e14 req-63fdb638-2435-4394-9625-9185c492963a service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:24.795898 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a24f4a72-1b1d-44c5-b8b8-69952e9f3e14 req-63fdb638-2435-4394-9625-9185c492963a service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:24.796109 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a24f4a72-1b1d-44c5-b8b8-69952e9f3e14 req-63fdb638-2435-4394-9625-9185c492963a service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:24.796109 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-a24f4a72-1b1d-44c5-b8b8-69952e9f3e14 req-63fdb638-2435-4394-9625-9185c492963a service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] No event matching network-vif-plugged-2af2f66c-7de8-49e4-badd-16d0764caff6 in dict_keys([('network-vif-plugged', 'ff5a5c31-e634-489a-b565-418e87aaa11b'), ('network-vif-plugged', 'ed1393f8-f25b-489d-9635-82b920d33137'), ('network-vif-plugged', '07a46cd4-912b-4863-8b8f-f345fe260bd0')]) {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 25 04:43:24.796345 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-a24f4a72-1b1d-44c5-b8b8-69952e9f3e14 req-63fdb638-2435-4394-9625-9185c492963a service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received unexpected event network-vif-plugged-2af2f66c-7de8-49e4-badd-16d0764caff6 for instance with vm_state building and task_state spawning. Jun 25 04:43:24.796428 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-a24f4a72-1b1d-44c5-b8b8-69952e9f3e14 req-63fdb638-2435-4394-9625-9185c492963a service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-plugged-07a46cd4-912b-4863-8b8f-f345fe260bd0 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:24.797281 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a24f4a72-1b1d-44c5-b8b8-69952e9f3e14 req-63fdb638-2435-4394-9625-9185c492963a service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:24.797281 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a24f4a72-1b1d-44c5-b8b8-69952e9f3e14 req-63fdb638-2435-4394-9625-9185c492963a service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:24.797281 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a24f4a72-1b1d-44c5-b8b8-69952e9f3e14 req-63fdb638-2435-4394-9625-9185c492963a service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:24.797281 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-a24f4a72-1b1d-44c5-b8b8-69952e9f3e14 req-63fdb638-2435-4394-9625-9185c492963a service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Processing event network-vif-plugged-07a46cd4-912b-4863-8b8f-f345fe260bd0 {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:43:24.797688 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-a24f4a72-1b1d-44c5-b8b8-69952e9f3e14 req-63fdb638-2435-4394-9625-9185c492963a service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-plugged-07a46cd4-912b-4863-8b8f-f345fe260bd0 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:24.797688 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a24f4a72-1b1d-44c5-b8b8-69952e9f3e14 req-63fdb638-2435-4394-9625-9185c492963a service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:24.797762 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a24f4a72-1b1d-44c5-b8b8-69952e9f3e14 req-63fdb638-2435-4394-9625-9185c492963a service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:24.797964 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a24f4a72-1b1d-44c5-b8b8-69952e9f3e14 req-63fdb638-2435-4394-9625-9185c492963a service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:24.798075 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-a24f4a72-1b1d-44c5-b8b8-69952e9f3e14 req-63fdb638-2435-4394-9625-9185c492963a service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] No event matching network-vif-plugged-07a46cd4-912b-4863-8b8f-f345fe260bd0 in dict_keys([('network-vif-plugged', 'ff5a5c31-e634-489a-b565-418e87aaa11b'), ('network-vif-plugged', 'ed1393f8-f25b-489d-9635-82b920d33137')]) {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 25 04:43:24.798201 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-a24f4a72-1b1d-44c5-b8b8-69952e9f3e14 req-63fdb638-2435-4394-9625-9185c492963a service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received unexpected event network-vif-plugged-07a46cd4-912b-4863-8b8f-f345fe260bd0 for instance with vm_state building and task_state spawning. Jun 25 04:43:24.803464 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:24.848398 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:24.851006 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:24.882739 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:24.939770 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:25.006980 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:43:25.007150 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:43:25.007354 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] No VIF found with MAC fa:16:3e:cc:df:5a, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:43:25.007922 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Using config drive Jun 25 04:43:25.039169 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:25.049855 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:25.242753 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1337030f-eb4b-4598-a941-100e4ed7aa81 req-779d6d02-61fb-4193-ab6a-978765c72375 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-plugged-a36eb1f7-4779-4078-a224-bc487abd01a6 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:25.243772 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1337030f-eb4b-4598-a941-100e4ed7aa81 req-779d6d02-61fb-4193-ab6a-978765c72375 service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:25.243937 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1337030f-eb4b-4598-a941-100e4ed7aa81 req-779d6d02-61fb-4193-ab6a-978765c72375 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:25.244112 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1337030f-eb4b-4598-a941-100e4ed7aa81 req-779d6d02-61fb-4193-ab6a-978765c72375 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:25.244404 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1337030f-eb4b-4598-a941-100e4ed7aa81 req-779d6d02-61fb-4193-ab6a-978765c72375 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] No event matching network-vif-plugged-a36eb1f7-4779-4078-a224-bc487abd01a6 in dict_keys([('network-vif-plugged', 'ff5a5c31-e634-489a-b565-418e87aaa11b'), ('network-vif-plugged', 'ed1393f8-f25b-489d-9635-82b920d33137')]) {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 25 04:43:25.244535 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-1337030f-eb4b-4598-a941-100e4ed7aa81 req-779d6d02-61fb-4193-ab6a-978765c72375 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received unexpected event network-vif-plugged-a36eb1f7-4779-4078-a224-bc487abd01a6 for instance with vm_state building and task_state spawning. Jun 25 04:43:25.244981 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1337030f-eb4b-4598-a941-100e4ed7aa81 req-779d6d02-61fb-4193-ab6a-978765c72375 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-plugged-ff5a5c31-e634-489a-b565-418e87aaa11b {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:25.245265 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1337030f-eb4b-4598-a941-100e4ed7aa81 req-779d6d02-61fb-4193-ab6a-978765c72375 service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:25.245434 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1337030f-eb4b-4598-a941-100e4ed7aa81 req-779d6d02-61fb-4193-ab6a-978765c72375 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:25.245751 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1337030f-eb4b-4598-a941-100e4ed7aa81 req-779d6d02-61fb-4193-ab6a-978765c72375 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:25.245751 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1337030f-eb4b-4598-a941-100e4ed7aa81 req-779d6d02-61fb-4193-ab6a-978765c72375 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Processing event network-vif-plugged-ff5a5c31-e634-489a-b565-418e87aaa11b {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:43:25.248630 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1337030f-eb4b-4598-a941-100e4ed7aa81 req-779d6d02-61fb-4193-ab6a-978765c72375 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-plugged-ff5a5c31-e634-489a-b565-418e87aaa11b {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:25.248630 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1337030f-eb4b-4598-a941-100e4ed7aa81 req-779d6d02-61fb-4193-ab6a-978765c72375 service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:25.248630 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1337030f-eb4b-4598-a941-100e4ed7aa81 req-779d6d02-61fb-4193-ab6a-978765c72375 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:25.248630 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1337030f-eb4b-4598-a941-100e4ed7aa81 req-779d6d02-61fb-4193-ab6a-978765c72375 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:25.248630 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1337030f-eb4b-4598-a941-100e4ed7aa81 req-779d6d02-61fb-4193-ab6a-978765c72375 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] No event matching network-vif-plugged-ff5a5c31-e634-489a-b565-418e87aaa11b in dict_keys([('network-vif-plugged', 'ed1393f8-f25b-489d-9635-82b920d33137')]) {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 25 04:43:25.248630 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-1337030f-eb4b-4598-a941-100e4ed7aa81 req-779d6d02-61fb-4193-ab6a-978765c72375 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received unexpected event network-vif-plugged-ff5a5c31-e634-489a-b565-418e87aaa11b for instance with vm_state building and task_state spawning. Jun 25 04:43:25.259773 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:25.260289 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] VM Started (Lifecycle Event) Jun 25 04:43:25.518067 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:25.541059 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-c835c4a3-2ac6-43ec-866e-8d637c2e2308 req-92d74be9-9503-493f-be8c-a3d18f967efc service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-plugged-a7d7f523-bf9e-4f8f-881d-9d05c514eb54 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:25.541278 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-c835c4a3-2ac6-43ec-866e-8d637c2e2308 req-92d74be9-9503-493f-be8c-a3d18f967efc service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:25.541467 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-c835c4a3-2ac6-43ec-866e-8d637c2e2308 req-92d74be9-9503-493f-be8c-a3d18f967efc service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:25.542269 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-c835c4a3-2ac6-43ec-866e-8d637c2e2308 req-92d74be9-9503-493f-be8c-a3d18f967efc service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:25.542428 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-c835c4a3-2ac6-43ec-866e-8d637c2e2308 req-92d74be9-9503-493f-be8c-a3d18f967efc service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] No event matching network-vif-plugged-a7d7f523-bf9e-4f8f-881d-9d05c514eb54 in dict_keys([('network-vif-plugged', 'ed1393f8-f25b-489d-9635-82b920d33137')]) {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 25 04:43:25.542585 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-c835c4a3-2ac6-43ec-866e-8d637c2e2308 req-92d74be9-9503-493f-be8c-a3d18f967efc service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received unexpected event network-vif-plugged-a7d7f523-bf9e-4f8f-881d-9d05c514eb54 for instance with vm_state building and task_state spawning. Jun 25 04:43:25.739664 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Creating config drive at /opt/stack/data/nova/instances/097ff869-4376-4450-9a31-5389fe5e44c8/disk.config Jun 25 04:43:25.743789 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/097ff869-4376-4450-9a31-5389fe5e44c8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5m__irkf {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:25.767777 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:25.772216 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Paused> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:25.772623 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] VM Paused (Lifecycle Event) Jun 25 04:43:25.806949 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/097ff869-4376-4450-9a31-5389fe5e44c8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5m__irkf" returned: 0 in 0.063s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:26.278380 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:26.281023 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:43:26.360641 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:26.391706 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:26.398081 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:26.505534 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:26.679217 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-93652d00-21ca-4ec4-a222-f7c57ea5629d tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Acquiring lock "7671d823-fb04-46c9-80d9-e171d8032199" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:26.679217 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-93652d00-21ca-4ec4-a222-f7c57ea5629d tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "7671d823-fb04-46c9-80d9-e171d8032199" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:26.679759 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-93652d00-21ca-4ec4-a222-f7c57ea5629d tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Acquiring lock "7671d823-fb04-46c9-80d9-e171d8032199-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:26.679759 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-93652d00-21ca-4ec4-a222-f7c57ea5629d tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "7671d823-fb04-46c9-80d9-e171d8032199-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:26.679759 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-93652d00-21ca-4ec4-a222-f7c57ea5629d tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "7671d823-fb04-46c9-80d9-e171d8032199-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:26.684953 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-93652d00-21ca-4ec4-a222-f7c57ea5629d tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Terminating instance Jun 25 04:43:26.784236 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] During sync_power_state the instance has a pending task (spawning). Skip. Jun 25 04:43:26.784547 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:26.784722 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] VM Started (Lifecycle Event) Jun 25 04:43:26.786889 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:26.788940 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:26.792357 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:26.822685 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:26.905853 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-b419a842-c013-4e7c-a91d-60741e02a22f req-792208be-4115-4e12-bdd4-24c33879c845 service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Received event network-vif-plugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:26.906070 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b419a842-c013-4e7c-a91d-60741e02a22f req-792208be-4115-4e12-bdd4-24c33879c845 service nova] Acquiring lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:26.906368 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b419a842-c013-4e7c-a91d-60741e02a22f req-792208be-4115-4e12-bdd4-24c33879c845 service nova] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:26.906368 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b419a842-c013-4e7c-a91d-60741e02a22f req-792208be-4115-4e12-bdd4-24c33879c845 service nova] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:26.906704 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-b419a842-c013-4e7c-a91d-60741e02a22f req-792208be-4115-4e12-bdd4-24c33879c845 service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Processing event network-vif-plugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:43:26.906834 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-b419a842-c013-4e7c-a91d-60741e02a22f req-792208be-4115-4e12-bdd4-24c33879c845 service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Received event network-vif-plugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:26.911153 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b419a842-c013-4e7c-a91d-60741e02a22f req-792208be-4115-4e12-bdd4-24c33879c845 service nova] Acquiring lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:26.911338 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b419a842-c013-4e7c-a91d-60741e02a22f req-792208be-4115-4e12-bdd4-24c33879c845 service nova] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:26.911574 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b419a842-c013-4e7c-a91d-60741e02a22f req-792208be-4115-4e12-bdd4-24c33879c845 service nova] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:26.911765 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-b419a842-c013-4e7c-a91d-60741e02a22f req-792208be-4115-4e12-bdd4-24c33879c845 service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] No waiting events found dispatching network-vif-plugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:43:26.911925 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-b419a842-c013-4e7c-a91d-60741e02a22f req-792208be-4115-4e12-bdd4-24c33879c845 service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Received unexpected event network-vif-plugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 for instance with vm_state building and task_state spawning. Jun 25 04:43:26.912087 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-b419a842-c013-4e7c-a91d-60741e02a22f req-792208be-4115-4e12-bdd4-24c33879c845 service nova] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Received event network-vif-plugged-32349050-a5cd-4950-b24a-c8c426cfbf07 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:26.912906 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b419a842-c013-4e7c-a91d-60741e02a22f req-792208be-4115-4e12-bdd4-24c33879c845 service nova] Acquiring lock "097ff869-4376-4450-9a31-5389fe5e44c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:26.912906 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b419a842-c013-4e7c-a91d-60741e02a22f req-792208be-4115-4e12-bdd4-24c33879c845 service nova] Lock "097ff869-4376-4450-9a31-5389fe5e44c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:26.914016 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:43:26.914618 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b419a842-c013-4e7c-a91d-60741e02a22f req-792208be-4115-4e12-bdd4-24c33879c845 service nova] Lock "097ff869-4376-4450-9a31-5389fe5e44c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:26.914618 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-b419a842-c013-4e7c-a91d-60741e02a22f req-792208be-4115-4e12-bdd4-24c33879c845 service nova] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Processing event network-vif-plugged-32349050-a5cd-4950-b24a-c8c426cfbf07 {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:43:26.917511 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Guest created on hypervisor {{(pid=98952) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 25 04:43:26.924519 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Instance spawned successfully. Jun 25 04:43:26.925006 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 25 04:43:27.192619 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-93652d00-21ca-4ec4-a222-f7c57ea5629d tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Start destroying the instance on the hypervisor. {{(pid=98952) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 25 04:43:27.221750 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:27.242165 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:27.259591 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:27.266187 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:27.288240 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:27.299545 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:43:27.304098 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:27.308337 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:27.443145 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Found default for hw_cdrom_bus of ide {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:27.443368 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Found default for hw_disk_bus of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:27.446503 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Found default for hw_input_bus of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:27.446503 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Found default for hw_pointer_model of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:27.446503 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Found default for hw_video_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:27.446503 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Found default for hw_vif_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:27.569110 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Instance destroyed successfully. Jun 25 04:43:27.570878 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-93652d00-21ca-4ec4-a222-f7c57ea5629d tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lazy-loading 'resources' on Instance uuid 7671d823-fb04-46c9-80d9-e171d8032199 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:43:27.638708 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-90d9576a-bce5-4b86-a977-8ebc915406dd req-9b758c29-5746-4b19-9b31-a7c452ac7007 service nova] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Received event network-vif-unplugged-22b45284-c52f-466b-a2e1-f273384c1dbc {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:27.639017 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-90d9576a-bce5-4b86-a977-8ebc915406dd req-9b758c29-5746-4b19-9b31-a7c452ac7007 service nova] Acquiring lock "7671d823-fb04-46c9-80d9-e171d8032199-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:27.639981 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-90d9576a-bce5-4b86-a977-8ebc915406dd req-9b758c29-5746-4b19-9b31-a7c452ac7007 service nova] Lock "7671d823-fb04-46c9-80d9-e171d8032199-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:27.639981 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-90d9576a-bce5-4b86-a977-8ebc915406dd req-9b758c29-5746-4b19-9b31-a7c452ac7007 service nova] Lock "7671d823-fb04-46c9-80d9-e171d8032199-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:27.641503 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-90d9576a-bce5-4b86-a977-8ebc915406dd req-9b758c29-5746-4b19-9b31-a7c452ac7007 service nova] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] No waiting events found dispatching network-vif-unplugged-22b45284-c52f-466b-a2e1-f273384c1dbc {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:43:27.641774 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-90d9576a-bce5-4b86-a977-8ebc915406dd req-9b758c29-5746-4b19-9b31-a7c452ac7007 service nova] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Received event network-vif-unplugged-22b45284-c52f-466b-a2e1-f273384c1dbc for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:43:27.744912 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:43:27.750820 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Guest created on hypervisor {{(pid=98952) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 25 04:43:27.753175 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Instance spawned successfully. Jun 25 04:43:27.753662 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 25 04:43:27.802133 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] During sync_power_state the instance has a pending task (spawning). Skip. Jun 25 04:43:27.802645 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Paused> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:27.802645 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] VM Paused (Lifecycle Event) Jun 25 04:43:27.956706 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Took 10.40 seconds to spawn the instance on the hypervisor. Jun 25 04:43:27.956706 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:28.017634 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8025e572-1c02-4a4b-83b7-a747f86cab63 req-c426ed27-d5d4-402e-9527-b6a8e96e8a26 service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Received event network-vif-plugged-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:28.017634 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8025e572-1c02-4a4b-83b7-a747f86cab63 req-c426ed27-d5d4-402e-9527-b6a8e96e8a26 service nova] Acquiring lock "ea0f9737-865a-4199-9077-b64e88af15db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:28.017634 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8025e572-1c02-4a4b-83b7-a747f86cab63 req-c426ed27-d5d4-402e-9527-b6a8e96e8a26 service nova] Lock "ea0f9737-865a-4199-9077-b64e88af15db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:28.018191 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8025e572-1c02-4a4b-83b7-a747f86cab63 req-c426ed27-d5d4-402e-9527-b6a8e96e8a26 service nova] Lock "ea0f9737-865a-4199-9077-b64e88af15db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:28.018191 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8025e572-1c02-4a4b-83b7-a747f86cab63 req-c426ed27-d5d4-402e-9527-b6a8e96e8a26 service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Processing event network-vif-plugged-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:43:28.020321 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Instance event wait completed in 11 seconds for network-vif-plugged {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:43:28.030072 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Guest created on hypervisor {{(pid=98952) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 25 04:43:28.035073 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Instance spawned successfully. Jun 25 04:43:28.035073 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 25 04:43:28.073478 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-93652d00-21ca-4ec4-a222-f7c57ea5629d tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-209994954',display_name='tempest-VolumesActionsTest-instance-209994954',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-volumesactionstest-instance-209994954',id=15,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-25T04:43:23Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='00cdd814e374462e9477baf02d6c2fdb',ramdisk_id='',reservation_id='r-2ejqrb53',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-93709413',owner_user_name='tempest-VolumesActionsTest-93709413-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:43:24Z,user_data=None,user_id='7f9bd46f11cd4d38bbf9926be137ca8e',uuid=7671d823-fb04-46c9-80d9-e171d8032199,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22b45284-c52f-466b-a2e1-f273384c1dbc", "address": "fa:16:3e:98:32:46", "network": {"id": "d59f1de2-a0fd-4318-9724-66a1bbe8ec86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-557005970-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "00cdd814e374462e9477baf02d6c2fdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b45284-c5", "ovs_interfaceid": "22b45284-c52f-466b-a2e1-f273384c1dbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:43:28.073698 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-93652d00-21ca-4ec4-a222-f7c57ea5629d tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Converting VIF {"id": "22b45284-c52f-466b-a2e1-f273384c1dbc", "address": "fa:16:3e:98:32:46", "network": {"id": "d59f1de2-a0fd-4318-9724-66a1bbe8ec86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-557005970-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "00cdd814e374462e9477baf02d6c2fdb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b45284-c5", "ovs_interfaceid": "22b45284-c52f-466b-a2e1-f273384c1dbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:28.074469 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-93652d00-21ca-4ec4-a222-f7c57ea5629d tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:32:46,bridge_name='br-int',has_traffic_filtering=True,id=22b45284-c52f-466b-a2e1-f273384c1dbc,network=Network(d59f1de2-a0fd-4318-9724-66a1bbe8ec86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b45284-c5') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:28.074745 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-93652d00-21ca-4ec4-a222-f7c57ea5629d tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:32:46,bridge_name='br-int',has_traffic_filtering=True,id=22b45284-c52f-466b-a2e1-f273384c1dbc,network=Network(d59f1de2-a0fd-4318-9724-66a1bbe8ec86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b45284-c5') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:43:28.078582 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:28.078582 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22b45284-c5, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:28.080707 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:28.081549 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:28.088333 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:28.090665 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:28.090665 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a469b092-c26c-4f7d-80eb-6483c2481110) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:28.091461 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:28.092243 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:28.094198 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:28.099628 np0000003587 nova-compute[98952]: INFO os_vif [None req-93652d00-21ca-4ec4-a222-f7c57ea5629d tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:32:46,bridge_name='br-int',has_traffic_filtering=True,id=22b45284-c52f-466b-a2e1-f273384c1dbc,network=Network(d59f1de2-a0fd-4318-9724-66a1bbe8ec86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b45284-c5') Jun 25 04:43:28.099769 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-93652d00-21ca-4ec4-a222-f7c57ea5629d tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Deleting instance files /opt/stack/data/nova/instances/7671d823-fb04-46c9-80d9-e171d8032199_del Jun 25 04:43:28.100517 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-93652d00-21ca-4ec4-a222-f7c57ea5629d tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Deletion of /opt/stack/data/nova/instances/7671d823-fb04-46c9-80d9-e171d8032199_del complete Jun 25 04:43:28.270498 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Found default for hw_cdrom_bus of ide {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:28.270498 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Found default for hw_disk_bus of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:28.270498 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Found default for hw_input_bus of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:28.270498 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Found default for hw_pointer_model of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:28.273631 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Found default for hw_video_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:28.273631 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Found default for hw_vif_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:28.305823 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:28.309742 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:28.310317 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] VM Resumed (Lifecycle Event) Jun 25 04:43:28.480618 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Took 23.59 seconds to build instance. Jun 25 04:43:28.551135 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Found default for hw_cdrom_bus of ide {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:28.551334 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Found default for hw_disk_bus of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:28.551775 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Found default for hw_input_bus of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:28.552088 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Found default for hw_pointer_model of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:28.552852 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Found default for hw_video_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:28.553080 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Found default for hw_vif_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:28.609415 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-93652d00-21ca-4ec4-a222-f7c57ea5629d tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Took 1.42 seconds to destroy the instance on the hypervisor. Jun 25 04:43:28.610795 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._common.loopingcall [None req-93652d00-21ca-4ec4-a222-f7c57ea5629d tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98952) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 25 04:43:28.611924 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [-] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Deallocating network for instance {{(pid=98952) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 25 04:43:28.611924 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] deallocate_for_instance() {{(pid=98952) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 25 04:43:28.612411 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:28.773872 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:28.784406 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Took 8.65 seconds to spawn the instance on the hypervisor. Jun 25 04:43:28.784406 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:28.814746 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:28.816390 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:43:28.983766 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-3357a5ab-c5cd-41b0-875a-b0c050fde878 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 25.108s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:29.039693 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-f6f0ec9f-31c5-4b7f-b98c-5ec5d17e92e1 req-25b7c368-8924-4415-b2a7-3c50da980bee service nova] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Received event network-vif-plugged-32349050-a5cd-4950-b24a-c8c426cfbf07 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:29.041202 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-f6f0ec9f-31c5-4b7f-b98c-5ec5d17e92e1 req-25b7c368-8924-4415-b2a7-3c50da980bee service nova] Acquiring lock "097ff869-4376-4450-9a31-5389fe5e44c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:29.041202 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-f6f0ec9f-31c5-4b7f-b98c-5ec5d17e92e1 req-25b7c368-8924-4415-b2a7-3c50da980bee service nova] Lock "097ff869-4376-4450-9a31-5389fe5e44c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:29.041202 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-f6f0ec9f-31c5-4b7f-b98c-5ec5d17e92e1 req-25b7c368-8924-4415-b2a7-3c50da980bee service nova] Lock "097ff869-4376-4450-9a31-5389fe5e44c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:29.041202 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-f6f0ec9f-31c5-4b7f-b98c-5ec5d17e92e1 req-25b7c368-8924-4415-b2a7-3c50da980bee service nova] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] No waiting events found dispatching network-vif-plugged-32349050-a5cd-4950-b24a-c8c426cfbf07 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:43:29.041202 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-f6f0ec9f-31c5-4b7f-b98c-5ec5d17e92e1 req-25b7c368-8924-4415-b2a7-3c50da980bee service nova] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Received unexpected event network-vif-plugged-32349050-a5cd-4950-b24a-c8c426cfbf07 for instance with vm_state active and task_state None. Jun 25 04:43:29.061899 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Took 19.74 seconds to spawn the instance on the hypervisor. Jun 25 04:43:29.063046 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:29.302471 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Took 14.60 seconds to build instance. Jun 25 04:43:29.320857 np0000003587 nova-compute[98952]: DEBUG nova.utils [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Queued Task(fn=>, remaining_delay=14.999693201000127 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:43:29.321383 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:29.322607 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] VM Started (Lifecycle Event) Jun 25 04:43:29.323263 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.996848640000053 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:43:29.323263 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.996665380000195 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:43:29.582833 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Took 25.64 seconds to build instance. Jun 25 04:43:29.698203 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:29.752531 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1de475a3-99f6-41b3-b543-80eec8b81443 req-fe5c758d-40db-48d5-9a3b-a1866cb1c94f service nova] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Received event network-vif-unplugged-22b45284-c52f-466b-a2e1-f273384c1dbc {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:29.752531 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1de475a3-99f6-41b3-b543-80eec8b81443 req-fe5c758d-40db-48d5-9a3b-a1866cb1c94f service nova] Acquiring lock "7671d823-fb04-46c9-80d9-e171d8032199-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:29.753543 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1de475a3-99f6-41b3-b543-80eec8b81443 req-fe5c758d-40db-48d5-9a3b-a1866cb1c94f service nova] Lock "7671d823-fb04-46c9-80d9-e171d8032199-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:29.753543 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1de475a3-99f6-41b3-b543-80eec8b81443 req-fe5c758d-40db-48d5-9a3b-a1866cb1c94f service nova] Lock "7671d823-fb04-46c9-80d9-e171d8032199-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:29.753543 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1de475a3-99f6-41b3-b543-80eec8b81443 req-fe5c758d-40db-48d5-9a3b-a1866cb1c94f service nova] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] No waiting events found dispatching network-vif-unplugged-22b45284-c52f-466b-a2e1-f273384c1dbc {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:43:29.753543 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1de475a3-99f6-41b3-b543-80eec8b81443 req-fe5c758d-40db-48d5-9a3b-a1866cb1c94f service nova] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Received event network-vif-unplugged-22b45284-c52f-466b-a2e1-f273384c1dbc for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:43:29.806084 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "097ff869-4376-4450-9a31-5389fe5e44c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.111s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:29.825811 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:29.831448 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:43:29.887890 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:29.987683 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:30.088310 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e84f007b-529d-4f0d-9b69-876ee65ea1f3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "ea0f9737-865a-4199-9077-b64e88af15db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 27.156s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:30.143788 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-4a9db0f8-129d-42a9-a8b9-9e7b8e4e00a3 req-6710e20f-feb0-4ec9-aaf8-58ee9fbe0793 service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Received event network-vif-plugged-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:30.143908 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4a9db0f8-129d-42a9-a8b9-9e7b8e4e00a3 req-6710e20f-feb0-4ec9-aaf8-58ee9fbe0793 service nova] Acquiring lock "ea0f9737-865a-4199-9077-b64e88af15db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:30.144141 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4a9db0f8-129d-42a9-a8b9-9e7b8e4e00a3 req-6710e20f-feb0-4ec9-aaf8-58ee9fbe0793 service nova] Lock "ea0f9737-865a-4199-9077-b64e88af15db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:30.144370 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4a9db0f8-129d-42a9-a8b9-9e7b8e4e00a3 req-6710e20f-feb0-4ec9-aaf8-58ee9fbe0793 service nova] Lock "ea0f9737-865a-4199-9077-b64e88af15db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:30.145624 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-4a9db0f8-129d-42a9-a8b9-9e7b8e4e00a3 req-6710e20f-feb0-4ec9-aaf8-58ee9fbe0793 service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] No waiting events found dispatching network-vif-plugged-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:43:30.146389 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-4a9db0f8-129d-42a9-a8b9-9e7b8e4e00a3 req-6710e20f-feb0-4ec9-aaf8-58ee9fbe0793 service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Received unexpected event network-vif-plugged-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 for instance with vm_state active and task_state None. Jun 25 04:43:30.146389 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-4a9db0f8-129d-42a9-a8b9-9e7b8e4e00a3 req-6710e20f-feb0-4ec9-aaf8-58ee9fbe0793 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-plugged-ed1393f8-f25b-489d-9635-82b920d33137 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:30.146389 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4a9db0f8-129d-42a9-a8b9-9e7b8e4e00a3 req-6710e20f-feb0-4ec9-aaf8-58ee9fbe0793 service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:30.146851 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4a9db0f8-129d-42a9-a8b9-9e7b8e4e00a3 req-6710e20f-feb0-4ec9-aaf8-58ee9fbe0793 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:30.147069 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4a9db0f8-129d-42a9-a8b9-9e7b8e4e00a3 req-6710e20f-feb0-4ec9-aaf8-58ee9fbe0793 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:30.147271 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-4a9db0f8-129d-42a9-a8b9-9e7b8e4e00a3 req-6710e20f-feb0-4ec9-aaf8-58ee9fbe0793 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Processing event network-vif-plugged-ed1393f8-f25b-489d-9635-82b920d33137 {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:43:30.147425 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-4a9db0f8-129d-42a9-a8b9-9e7b8e4e00a3 req-6710e20f-feb0-4ec9-aaf8-58ee9fbe0793 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-plugged-ed1393f8-f25b-489d-9635-82b920d33137 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:30.148199 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4a9db0f8-129d-42a9-a8b9-9e7b8e4e00a3 req-6710e20f-feb0-4ec9-aaf8-58ee9fbe0793 service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:30.148899 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4a9db0f8-129d-42a9-a8b9-9e7b8e4e00a3 req-6710e20f-feb0-4ec9-aaf8-58ee9fbe0793 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:30.152204 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Instance event wait completed in 6 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:43:30.154201 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4a9db0f8-129d-42a9-a8b9-9e7b8e4e00a3 req-6710e20f-feb0-4ec9-aaf8-58ee9fbe0793 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:30.154201 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-4a9db0f8-129d-42a9-a8b9-9e7b8e4e00a3 req-6710e20f-feb0-4ec9-aaf8-58ee9fbe0793 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] No waiting events found dispatching network-vif-plugged-ed1393f8-f25b-489d-9635-82b920d33137 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:43:30.154201 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-4a9db0f8-129d-42a9-a8b9-9e7b8e4e00a3 req-6710e20f-feb0-4ec9-aaf8-58ee9fbe0793 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received unexpected event network-vif-plugged-ed1393f8-f25b-489d-9635-82b920d33137 for instance with vm_state building and task_state spawning. Jun 25 04:43:30.162582 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Guest created on hypervisor {{(pid=98952) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 25 04:43:30.165770 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Instance spawned successfully. Jun 25 04:43:30.166091 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 25 04:43:30.338575 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Paused> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:30.338575 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] VM Paused (Lifecycle Event) Jun 25 04:43:30.493615 np0000003587 nova-compute[98952]: INFO nova.compute.manager [-] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Took 1.88 seconds to deallocate network for instance. Jun 25 04:43:30.678845 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Found default for hw_cdrom_bus of ide {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:30.680072 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Found default for hw_disk_bus of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:30.684535 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Found default for hw_input_bus of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:30.685111 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Found default for hw_pointer_model of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:30.686089 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Found default for hw_video_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:30.687322 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Found default for hw_vif_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:30.806089 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Rescuing Jun 25 04:43:30.807816 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "refresh_cache-df96228c-c3b2-457d-9eb1-2e82186076f4" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:43:30.807816 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquired lock "refresh_cache-df96228c-c3b2-457d-9eb1-2e82186076f4" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:43:30.807816 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:43:30.842980 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:30.845972 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:30.846705 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] VM Resumed (Lifecycle Event) Jun 25 04:43:31.003580 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-93652d00-21ca-4ec4-a222-f7c57ea5629d tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:31.003855 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-93652d00-21ca-4ec4-a222-f7c57ea5629d tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:31.166443 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-5497c73d-e1b4-432c-8882-b22577587691 req-e291ad0f-bdfc-4fe5-bc66-a1f36114eef7 service nova] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Received event network-vif-deleted-22b45284-c52f-466b-a2e1-f273384c1dbc {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:31.202479 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Took 36.37 seconds to spawn the instance on the hypervisor. Jun 25 04:43:31.203085 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:31.309539 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:31.352146 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:31.363795 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:43:31.731898 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Took 53.15 seconds to build instance. Jun 25 04:43:31.867144 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:31.867312 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: ea0f9737-865a-4199-9077-b64e88af15db] VM Resumed (Lifecycle Event) Jun 25 04:43:31.979325 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-7f820da0-8ae4-4c29-95fd-facc749420ce req-1de5afad-a3f5-4cb6-873c-ecdfa7fcabd2 service nova] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Received event network-changed-189c1769-d72c-42d1-9e3e-1e978c8bf93f {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:31.979325 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-7f820da0-8ae4-4c29-95fd-facc749420ce req-1de5afad-a3f5-4cb6-873c-ecdfa7fcabd2 service nova] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Refreshing instance network info cache due to event network-changed-189c1769-d72c-42d1-9e3e-1e978c8bf93f. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:43:31.979325 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-7f820da0-8ae4-4c29-95fd-facc749420ce req-1de5afad-a3f5-4cb6-873c-ecdfa7fcabd2 service nova] Acquiring lock "refresh_cache-19180a23-a7e0-4354-b9f4-9ca57062fc06" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:43:31.979499 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-7f820da0-8ae4-4c29-95fd-facc749420ce req-1de5afad-a3f5-4cb6-873c-ecdfa7fcabd2 service nova] Acquired lock "refresh_cache-19180a23-a7e0-4354-b9f4-9ca57062fc06" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:43:31.979499 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-7f820da0-8ae4-4c29-95fd-facc749420ce req-1de5afad-a3f5-4cb6-873c-ecdfa7fcabd2 service nova] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Refreshing network info cache for port 189c1769-d72c-42d1-9e3e-1e978c8bf93f {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:43:31.996986 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:43:31.996986 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Cleaning up deleted instances {{(pid=98952) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}} Jun 25 04:43:32.090883 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:32.108214 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-93652d00-21ca-4ec4-a222-f7c57ea5629d tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:43:32.113994 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-93652d00-21ca-4ec4-a222-f7c57ea5629d tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:43:32.236587 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f17f23ac-c726-4367-a2c8-581bb10bb72e tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 54.659s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:32.282633 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Acquiring lock "097ff869-4376-4450-9a31-5389fe5e44c8" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:32.283401 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "097ff869-4376-4450-9a31-5389fe5e44c8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:32.307763 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Updating instance_info_cache with network_info: [{"id": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "address": "fa:16:3e:e9:03:29", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5c445e-b1", "ovs_interfaceid": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:32.370444 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:32.375653 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:43:32.487344 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-7f820da0-8ae4-4c29-95fd-facc749420ce req-1de5afad-a3f5-4cb6-873c-ecdfa7fcabd2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:32.501342 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] There are 0 instances to clean {{(pid=98952) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}} Jun 25 04:43:32.502670 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:43:32.502670 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Cleaning up deleted instances with incomplete migration {{(pid=98952) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}} Jun 25 04:43:32.617769 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-93652d00-21ca-4ec4-a222-f7c57ea5629d tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:43:32.789494 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lazy-loading 'flavor' on Instance uuid 097ff869-4376-4450-9a31-5389fe5e44c8 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:43:32.810342 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Releasing lock "refresh_cache-df96228c-c3b2-457d-9eb1-2e82186076f4" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:43:32.880174 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:32.880332 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] VM Resumed (Lifecycle Event) Jun 25 04:43:33.008193 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:43:33.024643 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-7f820da0-8ae4-4c29-95fd-facc749420ce req-1de5afad-a3f5-4cb6-873c-ecdfa7fcabd2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:33.097860 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:33.128958 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-93652d00-21ca-4ec4-a222-f7c57ea5629d tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.125s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:33.226206 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-7f820da0-8ae4-4c29-95fd-facc749420ce req-1de5afad-a3f5-4cb6-873c-ecdfa7fcabd2 service nova] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Updated VIF entry in instance network info cache for port 189c1769-d72c-42d1-9e3e-1e978c8bf93f. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:43:33.226601 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-7f820da0-8ae4-4c29-95fd-facc749420ce req-1de5afad-a3f5-4cb6-873c-ecdfa7fcabd2 service nova] [instance: 19180a23-a7e0-4354-b9f4-9ca57062fc06] Updating instance_info_cache with network_info: [{"id": "189c1769-d72c-42d1-9e3e-1e978c8bf93f", "address": "fa:16:3e:4f:40:83", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap189c1769-d7", "ovs_interfaceid": "189c1769-d72c-42d1-9e3e-1e978c8bf93f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:33.238969 np0000003587 nova-compute[98952]: INFO nova.scheduler.client.report [None req-93652d00-21ca-4ec4-a222-f7c57ea5629d tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Deleted allocations for instance 7671d823-fb04-46c9-80d9-e171d8032199 Jun 25 04:43:33.384102 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:33.392938 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:43:33.512913 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._threading.loopingcall [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98952) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 25 04:43:33.733193 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-7f820da0-8ae4-4c29-95fd-facc749420ce req-1de5afad-a3f5-4cb6-873c-ecdfa7fcabd2 service nova] Releasing lock "refresh_cache-19180a23-a7e0-4354-b9f4-9ca57062fc06" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:43:33.783291 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "57cfae71-795b-408e-850f-5293a22274c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:33.783505 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "57cfae71-795b-408e-850f-5293a22274c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:33.797875 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "097ff869-4376-4450-9a31-5389fe5e44c8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.514s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:33.828767 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "520409fb-f97c-4503-b97b-7cecd377102a" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:33.828921 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "520409fb-f97c-4503-b97b-7cecd377102a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:33.837996 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:33.838398 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:34.056497 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-10cee3b1-add2-4131-b369-673d56403312 req-29390747-3f1f-4d4c-80d6-2e01c0df6f53 service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Received event network-changed-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:34.056497 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-10cee3b1-add2-4131-b369-673d56403312 req-29390747-3f1f-4d4c-80d6-2e01c0df6f53 service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Refreshing instance network info cache due to event network-changed-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:43:34.056497 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-10cee3b1-add2-4131-b369-673d56403312 req-29390747-3f1f-4d4c-80d6-2e01c0df6f53 service nova] Acquiring lock "refresh_cache-ea0f9737-865a-4199-9077-b64e88af15db" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:43:34.056497 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-10cee3b1-add2-4131-b369-673d56403312 req-29390747-3f1f-4d4c-80d6-2e01c0df6f53 service nova] Acquired lock "refresh_cache-ea0f9737-865a-4199-9077-b64e88af15db" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:43:34.056497 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-10cee3b1-add2-4131-b369-673d56403312 req-29390747-3f1f-4d4c-80d6-2e01c0df6f53 service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Refreshing network info cache for port a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:43:34.251194 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-93652d00-21ca-4ec4-a222-f7c57ea5629d tempest-VolumesActionsTest-93709413 tempest-VolumesActionsTest-93709413-project-member] Lock "7671d823-fb04-46c9-80d9-e171d8032199" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.572s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:34.287424 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:43:34.337863 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:43:34.341410 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:43:34.377806 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:34.512714 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:43:34.513152 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:43:34.521360 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._threading.loopingcall [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.48 seconds {{(pid=98952) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 25 04:43:34.521360 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:34.528448 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:34.554512 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:34.559045 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-10cee3b1-add2-4131-b369-673d56403312 req-29390747-3f1f-4d4c-80d6-2e01c0df6f53 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:34.739308 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:34.747267 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:34.825954 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:34.839162 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:34.855749 np0000003587 nova-compute[98952]: DEBUG nova.utils [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Queued Task(fn=>, remaining_delay=14.999695005000149 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:43:34.862516 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Instance destroyed successfully. Jun 25 04:43:34.862958 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'numa_topology' on Instance uuid df96228c-c3b2-457d-9eb1-2e82186076f4 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:43:34.893790 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:34.902699 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:34.902929 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:34.908847 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:43:34.909984 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Claim successful on node np0000003587 Jun 25 04:43:34.952770 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:34.959705 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:34.991603 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:43:34.992018 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._threading.loopingcall [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98952) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 25 04:43:35.090116 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-10cee3b1-add2-4131-b369-673d56403312 req-29390747-3f1f-4d4c-80d6-2e01c0df6f53 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:35.313307 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Acquiring lock "097ff869-4376-4450-9a31-5389fe5e44c8" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:35.314294 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "097ff869-4376-4450-9a31-5389fe5e44c8" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:35.314294 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Attaching volume 3672114c-ce91-4feb-b609-ed100a301c37 to /dev/vdb Jun 25 04:43:35.348171 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-10cee3b1-add2-4131-b369-673d56403312 req-29390747-3f1f-4d4c-80d6-2e01c0df6f53 service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Updated VIF entry in instance network info cache for port a68140e2-5c7f-49c9-abbb-fbc11cf20cf2. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:43:35.348512 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-10cee3b1-add2-4131-b369-673d56403312 req-29390747-3f1f-4d4c-80d6-2e01c0df6f53 service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Updating instance_info_cache with network_info: [{"id": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "address": "fa:16:3e:57:c0:7f", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa68140e2-5c", "ovs_interfaceid": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:35.372607 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Attempting a stable device rescue Jun 25 04:43:35.386006 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.80', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003587', 'execute': None}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:43:35.401298 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.scaleio [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98952) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 25 04:43:35.439705 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Running cmd (subprocess): nvme version {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:35.477056 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] 'nvme version' failed. Not Retrying. {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 04:43:35.477456 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] nvme not present on system {{(pid=98952) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 25 04:43:35.491016 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98952) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 25 04:43:35.494607 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.lightos [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Current host hostNQN and IP(s) are ['10.4.3.80', 'fe80::f816:3eff:feea:dfe4', '192.168.40.6', 'fe80::f816:3eff:fe4f:7c42', '192.168.50.6', 'fe80::f816:3eff:fe6c:e6a6', '192.168.10.6', 'fe80::f816:3eff:fe17:d749', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::b035:28ff:fe70:6f4a', 'fe80::fc16:3eff:fe8c:f883', 'fe80::483f:f2ff:fe48:75ca', 'fe80::fc16:3eff:fe78:7ac8', 'fe80::1038:1dff:fe1c:d44b', 'fe80::fc16:3eff:fe3a:4858', 'fe80::fc16:3eff:fe4f:4083', 'fe80::fc16:3eff:fee6:e022', 'fe80::fc16:3eff:feab:c3d8', 'fe80::bca6:aaff:fef0:a5cf', 'fe80::fc16:3eff:fe6d:cc4e', 'fe80::fc16:3eff:fe07:d0f0', 'fe80::fc16:3eff:fee6:936b', 'fe80::fc16:3eff:fed3:389d', 'fe80::fc16:3eff:fe06:1da0', 'fe80::6086:d2ff:fe1e:62e1', 'fe80::fc16:3eff:fefe:a095', 'fe80::b4c2:93ff:fe6e:4d89', 'fe80::fc16:3eff:feee:97a2', 'fe80::fc16:3eff:fe57:c07f', 'fe80::fc16:3eff:fecc:30bf', 'fe80::fc16:3eff:feaa:4f74', 'fe80::d0a9:65ff:fe25:9a79', 'fe80::fc16:3eff:fe42:3aef', 'fe80::fc16:3eff:fee8:baea', 'fe80::fc16:3eff:fea7:57df', 'fe80::fc16:3eff:fefa:997d', 'fe80::f404:33ff:febc:fb62', 'fe80::fc16:3eff:fe95:908b', 'fe80::ac3e:37ff:fede:535d', 'fe80::fc16:3eff:fecc:df5a', 'fe80::60df:17ff:fe85:a095'] Jun 25 04:43:35.495358 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 25 04:43:35.495517 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] LIGHTOS: no hostnqn found. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 25 04:43:35.495796 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.80', 'host': 'np0000003587', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c81886224652', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a1feb13-40e2-4ac6-989e-b08a6fc0f283', 'nvme_native_multipath': False} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:43:35.496106 np0000003587 nova-compute[98952]: DEBUG nova.virt.block_device [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Updating existing volume attachment record: a4460e42-ccb3-44ee-ad3d-3f2be48d1e1d {{(pid=98952) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 25 04:43:35.509523 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98952) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}} Jun 25 04:43:35.519336 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Instance directory exists: not creating {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}} Jun 25 04:43:35.519877 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Creating image(s) Jun 25 04:43:35.520337 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "/opt/stack/data/nova/instances/df96228c-c3b2-457d-9eb1-2e82186076f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:35.520726 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "/opt/stack/data/nova/instances/df96228c-c3b2-457d-9eb1-2e82186076f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:35.521260 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "/opt/stack/data/nova/instances/df96228c-c3b2-457d-9eb1-2e82186076f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:35.521518 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'trusted_certs' on Instance uuid df96228c-c3b2-457d-9eb1-2e82186076f4 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:43:35.848732 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-bcdfefdd-19a3-438c-948b-bc4b548192d6 req-83c47f5f-916a-46b0-b28b-2d0da5d08401 service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Received event network-vif-unplugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:35.849465 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-bcdfefdd-19a3-438c-948b-bc4b548192d6 req-83c47f5f-916a-46b0-b28b-2d0da5d08401 service nova] Acquiring lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:35.849635 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-bcdfefdd-19a3-438c-948b-bc4b548192d6 req-83c47f5f-916a-46b0-b28b-2d0da5d08401 service nova] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:35.849763 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-bcdfefdd-19a3-438c-948b-bc4b548192d6 req-83c47f5f-916a-46b0-b28b-2d0da5d08401 service nova] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:35.849897 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-bcdfefdd-19a3-438c-948b-bc4b548192d6 req-83c47f5f-916a-46b0-b28b-2d0da5d08401 service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] No waiting events found dispatching network-vif-unplugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:43:35.850575 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-bcdfefdd-19a3-438c-948b-bc4b548192d6 req-83c47f5f-916a-46b0-b28b-2d0da5d08401 service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Received unexpected event network-vif-unplugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 for instance with vm_state active and task_state rescuing. Jun 25 04:43:35.851866 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-10cee3b1-add2-4131-b369-673d56403312 req-29390747-3f1f-4d4c-80d6-2e01c0df6f53 service nova] Releasing lock "refresh_cache-ea0f9737-865a-4199-9077-b64e88af15db" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:43:35.852196 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-10cee3b1-add2-4131-b369-673d56403312 req-29390747-3f1f-4d4c-80d6-2e01c0df6f53 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-changed-22fd01da-9056-4cd0-8489-c9f005bb66a5 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:35.852422 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-10cee3b1-add2-4131-b369-673d56403312 req-29390747-3f1f-4d4c-80d6-2e01c0df6f53 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Refreshing instance network info cache due to event network-changed-22fd01da-9056-4cd0-8489-c9f005bb66a5. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:43:35.852660 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-10cee3b1-add2-4131-b369-673d56403312 req-29390747-3f1f-4d4c-80d6-2e01c0df6f53 service nova] Acquiring lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:43:35.852800 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-10cee3b1-add2-4131-b369-673d56403312 req-29390747-3f1f-4d4c-80d6-2e01c0df6f53 service nova] Acquired lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:43:35.852970 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-10cee3b1-add2-4131-b369-673d56403312 req-29390747-3f1f-4d4c-80d6-2e01c0df6f53 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Refreshing network info cache for port 22fd01da-9056-4cd0-8489-c9f005bb66a5 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:43:35.994946 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:43:35.995267 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:43:35.995752 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:43:35.996098 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._threading.loopingcall [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98952) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 25 04:43:36.030654 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:43:36.030978 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "491123f78b6168677ef0bc8aab7b983b8534e154" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:36.031434 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "491123f78b6168677ef0bc8aab7b983b8534e154" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:36.073163 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Calling os-brick to attach iSCSI Volume {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 25 04:43:36.073708 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37', 'iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3672114c-ce91-4feb-b609-ed100a301c37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:43:36.073915 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:43:36.355843 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-10cee3b1-add2-4131-b369-673d56403312 req-29390747-3f1f-4d4c-80d6-2e01c0df6f53 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:36.935260 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-10cee3b1-add2-4131-b369-673d56403312 req-29390747-3f1f-4d4c-80d6-2e01c0df6f53 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:36.938297 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:43:36.938496 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:43:36.959603 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:36.964185 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:36.965137 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/491123f78b6168677ef0bc8aab7b983b8534e154.part --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:36.995787 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:43:36.995940 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98952) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 25 04:43:36.996316 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._threading.loopingcall [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98952) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 25 04:43:37.048155 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/491123f78b6168677ef0bc8aab7b983b8534e154.part --force-share --output=json" returned: 0 in 0.083s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:37.048469 np0000003587 nova-compute[98952]: DEBUG nova.virt.images [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] 31cb7f3d-4a66-4d78-b037-4ac398562137 was qcow2, converting to raw {{(pid=98952) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 25 04:43:37.051359 np0000003587 nova-compute[98952]: DEBUG nova.privsep.utils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98952) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 25 04:43:37.051359 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/491123f78b6168677ef0bc8aab7b983b8534e154.part /opt/stack/data/nova/instances/_base/491123f78b6168677ef0bc8aab7b983b8534e154.converted {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:37.151374 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-10cee3b1-add2-4131-b369-673d56403312 req-29390747-3f1f-4d4c-80d6-2e01c0df6f53 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Updated VIF entry in instance network info cache for port 22fd01da-9056-4cd0-8489-c9f005bb66a5. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:43:37.152343 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-10cee3b1-add2-4131-b369-673d56403312 req-29390747-3f1f-4d4c-80d6-2e01c0df6f53 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Updating instance_info_cache with network_info: [{"id": "22fd01da-9056-4cd0-8489-c9f005bb66a5", "address": "fa:16:3e:cc:30:bf", "network": {"id": "e2c0ccd0-a308-4fd9-8b43-472d9a2acb3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-814024004-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22fd01da-90", "ovs_interfaceid": "22fd01da-9056-4cd0-8489-c9f005bb66a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a36eb1f7-4779-4078-a224-bc487abd01a6", "address": "fa:16:3e:aa:4f:74", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36eb1f7-47", "ovs_interfaceid": "a36eb1f7-4779-4078-a224-bc487abd01a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff5a5c31-e634-489a-b565-418e87aaa11b", "address": "fa:16:3e:42:3a:ef", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5a5c31-e6", "ovs_interfaceid": "ff5a5c31-e634-489a-b565-418e87aaa11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a7d7f523-bf9e-4f8f-881d-9d05c514eb54", "address": "fa:16:3e:e8:ba:ea", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d7f523-bf", "ovs_interfaceid": "a7d7f523-bf9e-4f8f-881d-9d05c514eb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed1393f8-f25b-489d-9635-82b920d33137", "address": "fa:16:3e:a7:57:df", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped1393f8-f2", "ovs_interfaceid": "ed1393f8-f25b-489d-9635-82b920d33137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2af2f66c-7de8-49e4-badd-16d0764caff6", "address": "fa:16:3e:fa:99:7d", "network": {"id": "dbbc0276-7726-40fd-b3ee-f5a7887f5e72", "bridge": "br-int", "label": "tempest-device-tagging-net2-1967790487", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af2f66c-7d", "ovs_interfaceid": "2af2f66c-7de8-49e4-badd-16d0764caff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07a46cd4-912b-4863-8b8f-f345fe260bd0", "address": "fa:16:3e:95:90:8b", "network": {"id": "dbbc0276-7726-40fd-b3ee-f5a7887f5e72", "bridge": "br-int", "label": "tempest-device-tagging-net2-1967790487", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a46cd4-91", "ovs_interfaceid": "07a46cd4-912b-4863-8b8f-f345fe260bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:37.167573 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/491123f78b6168677ef0bc8aab7b983b8534e154.part /opt/stack/data/nova/instances/_base/491123f78b6168677ef0bc8aab7b983b8534e154.converted" returned: 0 in 0.117s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:37.174242 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/491123f78b6168677ef0bc8aab7b983b8534e154.converted --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:37.276803 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/491123f78b6168677ef0bc8aab7b983b8534e154.converted --force-share --output=json" returned: 0 in 0.102s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:37.279201 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "491123f78b6168677ef0bc8aab7b983b8534e154" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.246s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:37.279201 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:37.284623 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:37.290955 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "491123f78b6168677ef0bc8aab7b983b8534e154" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:37.290955 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "491123f78b6168677ef0bc8aab7b983b8534e154" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:37.290955 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:37.299713 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:37.299713 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/491123f78b6168677ef0bc8aab7b983b8534e154 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:37.403204 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/491123f78b6168677ef0bc8aab7b983b8534e154 --force-share --output=json" returned: 0 in 0.103s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:37.404122 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/491123f78b6168677ef0bc8aab7b983b8534e154,backing_fmt=raw /opt/stack/data/nova/instances/df96228c-c3b2-457d-9eb1-2e82186076f4/disk.rescue {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:37.444660 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:43:37.463852 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/491123f78b6168677ef0bc8aab7b983b8534e154,backing_fmt=raw /opt/stack/data/nova/instances/df96228c-c3b2-457d-9eb1-2e82186076f4/disk.rescue" returned: 0 in 0.060s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:37.464382 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "491123f78b6168677ef0bc8aab7b983b8534e154" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.176s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:37.464894 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'migration_context' on Instance uuid df96228c-c3b2-457d-9eb1-2e82186076f4 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:43:37.656372 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-10cee3b1-add2-4131-b369-673d56403312 req-29390747-3f1f-4d4c-80d6-2e01c0df6f53 service nova] Releasing lock "refresh_cache-25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:43:37.659390 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:37.922753 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-da33f02d-c697-4ba8-881d-2c10f9cccb63 req-4ddef5c4-6c37-47b3-aa56-673577bc734e service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Received event network-vif-unplugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:37.923025 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-da33f02d-c697-4ba8-881d-2c10f9cccb63 req-4ddef5c4-6c37-47b3-aa56-673577bc734e service nova] Acquiring lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:37.923618 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-da33f02d-c697-4ba8-881d-2c10f9cccb63 req-4ddef5c4-6c37-47b3-aa56-673577bc734e service nova] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:37.923618 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-da33f02d-c697-4ba8-881d-2c10f9cccb63 req-4ddef5c4-6c37-47b3-aa56-673577bc734e service nova] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:37.923618 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-da33f02d-c697-4ba8-881d-2c10f9cccb63 req-4ddef5c4-6c37-47b3-aa56-673577bc734e service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] No waiting events found dispatching network-vif-unplugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:43:37.923786 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-da33f02d-c697-4ba8-881d-2c10f9cccb63 req-4ddef5c4-6c37-47b3-aa56-673577bc734e service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Received unexpected event network-vif-unplugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 for instance with vm_state active and task_state rescuing. Jun 25 04:43:37.957210 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.054s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:37.959413 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:43:37.963452 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.007s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:37.968173 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:43:37.968460 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Claim successful on node np0000003587 Jun 25 04:43:37.973061 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:43:37.973706 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Created local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 25 04:43:37.974535 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Start _get_guest_xml network_info=[{"id": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "address": "fa:16:3e:e9:03:29", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "vif_mac": "fa:16:3e:e9:03:29"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5c445e-b1", "ovs_interfaceid": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue={'image_id': '31cb7f3d-4a66-4d78-b037-4ac398562137', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, 'status': 'reserved', 'instance': 'df96228c-c3b2-457d-9eb1-2e82186076f4', 'attached_at': '', 'detached_at': '', 'volume_id': '31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'serial': '31e8293d-50f2-4271-8cc5-bdd52f895f6d'}, 'attachment_id': '8d139240-e3dc-47e5-8f0c-6a1244e38c8a', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:43:37.975391 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'resources' on Instance uuid df96228c-c3b2-457d-9eb1-2e82186076f4 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:43:37.995180 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:43:38.096189 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:38.473090 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:43:38.473297 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:43:38.473763 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:38.474066 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:38.484586 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:43:38.488731 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:43:38.489456 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1478758735', uuid='df96228c-c3b2-457d-9eb1-2e82186076f4'), owner=OwnerMeta(userid='27ebe4b23b624995a52b9313ff9e318a', username='tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member', projectid='a5d52ed3b8de460eb65a8fb4ad1b015d', projectname='tempest-ServerBootFromVolumeStableRescueTest-6878904'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "address": "fa:16:3e:e9:03:29", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "vif_mac": "fa:16:3e:e9:03:29"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5c445e-b1", "ovs_interfaceid": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362618.4886305) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:43:38.491987 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:43:38.492507 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:43:38.493479 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:43:38.493822 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:43:38.495111 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:43:38.497504 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:43:38.497504 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:43:38.497504 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:43:38.497504 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:43:38.497816 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:43:38.497910 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:43:38.498290 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:43:38.498453 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:43:38.498714 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:43:38.498928 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:43:38.499202 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:43:38.499485 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'vcpu_model' on Instance uuid df96228c-c3b2-457d-9eb1-2e82186076f4 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:43:38.502312 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:38.604631 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9089e105690144639fa948de817a4f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904801097947c79fdb5c25d592ac04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:43:38.972969 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 25 04:43:39.004103 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:43:39.015466 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df96228c-c3b2-457d-9eb1-2e82186076f4/disk.config --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:39.055603 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.981s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:43:39.056259 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37', 'iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3672114c-ce91-4feb-b609-ed100a301c37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 25 04:43:39.086171 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:43:39.086829 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:43:39.088673 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:43:39.089591 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:43:39.102341 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.016s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:43:39.103660 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:43:39.114168 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:43:39.114168 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:39.121120 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:43:39.121120 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:39.121792 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df96228c-c3b2-457d-9eb1-2e82186076f4/disk.config --force-share --output=json" returned: 0 in 0.106s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:39.122464 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "/opt/stack/data/nova/instances/df96228c-c3b2-457d-9eb1-2e82186076f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:39.122775 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "/opt/stack/data/nova/instances/df96228c-c3b2-457d-9eb1-2e82186076f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:39.123705 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "/opt/stack/data/nova/instances/df96228c-c3b2-457d-9eb1-2e82186076f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:39.124317 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Calling os-brick to attach iSCSI Volume {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 25 04:43:39.125502 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:43:39.125502 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:43:39.133945 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37] added Jun 25 04:43:39.133945 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:43:39.133945 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:43:39.133945 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:43:39.133945 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:43:39.133945 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:43:39.133945 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:39.134272 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:43:39.134362 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0461(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:43:39.134620 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:43:39.138144 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37] added Jun 25 04:43:39.138144 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:43:39.138144 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:43:39.138144 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:43:39.138144 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:43:39.138144 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:43:39.138144 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:39.138731 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:43:39.138731 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.035(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:43:39.138877 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:43:39.168381 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Successfully created port: e964866c-f84b-40f3-9766-be7d03de0ccf {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:43:39.477150 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Start building block device mappings for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 25 04:43:39.897366 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:39.991374 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Successfully updated port: e964866c-f84b-40f3-9766-be7d03de0ccf {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:43:40.017821 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:43:40.018132 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:43:40.064407 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-3e5f6154-1c0b-462b-ab8e-09a254142373 req-1a310aa7-6125-4de4-a1e4-b2125fee62b7 service nova] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Received event network-changed-e964866c-f84b-40f3-9766-be7d03de0ccf {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:40.067896 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-3e5f6154-1c0b-462b-ab8e-09a254142373 req-1a310aa7-6125-4de4-a1e4-b2125fee62b7 service nova] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Refreshing instance network info cache due to event network-changed-e964866c-f84b-40f3-9766-be7d03de0ccf. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:43:40.068114 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-3e5f6154-1c0b-462b-ab8e-09a254142373 req-1a310aa7-6125-4de4-a1e4-b2125fee62b7 service nova] Acquiring lock "refresh_cache-57cfae71-795b-408e-850f-5293a22274c3" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:43:40.068252 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-3e5f6154-1c0b-462b-ab8e-09a254142373 req-1a310aa7-6125-4de4-a1e4-b2125fee62b7 service nova] Acquired lock "refresh_cache-57cfae71-795b-408e-850f-5293a22274c3" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:43:40.068412 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-3e5f6154-1c0b-462b-ab8e-09a254142373 req-1a310aa7-6125-4de4-a1e4-b2125fee62b7 service nova] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Refreshing network info cache for port e964866c-f84b-40f3-9766-be7d03de0ccf {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:43:40.135035 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:43:40.140384 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.40.100 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:43:40.158592 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.50.100 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:43:40.165856 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:40.173253 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:40.183284 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:40.212323 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:40.216852 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:43:40.299982 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37, portal: 192.168.40.100,3260] Jun 25 04:43:40.299982 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37, portal: 192.168.40.100,3260] successful. Jun 25 04:43:40.299982 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:40.310238 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37, portal: 192.168.50.100,3260] Jun 25 04:43:40.310238 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37, portal: 192.168.50.100,3260] successful. Jun 25 04:43:40.310238 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:40.316464 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:40.327302 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:40.346817 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:40.346817 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:40.346817 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:40.346817 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:40.346817 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:40.346817 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:40.346817 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:40.346817 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:40.346817 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:40.346817 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:40.346817 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:40.346817 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:40.346817 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:40.346817 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:40.346817 np0000003587 nova-compute[98952]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:40.346817 np0000003587 nova-compute[98952]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:40.346817 np0000003587 nova-compute[98952]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37 (non-flash) Jun 25 04:43:40.346817 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:40.346817 np0000003587 nova-compute[98952]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37 (non-flash) Jun 25 04:43:40.346817 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:40.346817 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:40.346817 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:40.346817 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:43:40.347450 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:40.347450 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:40.347450 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:40.347450 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:40.347450 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:40.347450 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:40.347450 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:40.347450 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:40.347450 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:40.347450 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:40.347450 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:40.347450 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:40.347450 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:40.347450 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:40.347450 np0000003587 nova-compute[98952]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:40.347450 np0000003587 nova-compute[98952]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:40.347450 np0000003587 nova-compute[98952]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37 (non-flash) Jun 25 04:43:40.347450 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:40.347450 np0000003587 nova-compute[98952]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37 (non-flash) Jun 25 04:43:40.347450 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:40.347450 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:40.347450 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:40.347450 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:43:40.347450 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.260s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:43:40.347450 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Connected to 192.168.40.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:43:40.349444 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] HCTL ('27', '-', '-', 0) found on session 29 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:43:40.349848 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Scanning host 27 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:43:40.359041 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:40.359041 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:40.359041 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:40.359041 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:40.359041 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:40.359041 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:40.359041 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:40.359041 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:40.359041 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:40.359041 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:40.359041 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:40.359041 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:40.359041 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:40.359041 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:40.359041 np0000003587 nova-compute[98952]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:40.359041 np0000003587 nova-compute[98952]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:40.359041 np0000003587 nova-compute[98952]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37 (non-flash) Jun 25 04:43:40.359041 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:40.359041 np0000003587 nova-compute[98952]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37 (non-flash) Jun 25 04:43:40.359041 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:40.359041 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:40.359041 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:40.359041 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:43:40.359945 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:40.359945 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:40.359945 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:40.359945 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:40.359945 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:40.359945 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:40.359945 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:40.359945 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:40.359945 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:40.359945 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:40.359945 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:40.359945 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:40.359945 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:40.359945 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:40.359945 np0000003587 nova-compute[98952]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:40.359945 np0000003587 nova-compute[98952]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:40.359945 np0000003587 nova-compute[98952]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37 (non-flash) Jun 25 04:43:40.359945 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:40.359945 np0000003587 nova-compute[98952]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37 (non-flash) Jun 25 04:43:40.359945 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:40.359945 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:40.359945 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:40.359945 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:43:40.359945 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.257s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:43:40.359945 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Connected to 192.168.50.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:43:40.362121 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] HCTL ('28', '-', '-', 0) found on session 30 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:43:40.362312 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Scanning host 28 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:43:40.371609 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Searching for a device in session 29 and hctl ['27', '*', '*', 0] yield: sdv {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:43:40.373373 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Connected to sdv using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3672114c-ce91-4feb-b609-ed100a301c37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:43:40.382916 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Searching for a device in session 30 and hctl ['28', '*', '*', 0] yield: sdw {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:43:40.382916 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Connected to sdw using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3672114c-ce91-4feb-b609-ed100a301c37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:43:40.495194 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "refresh_cache-57cfae71-795b-408e-850f-5293a22274c3" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:43:40.497099 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Start spawning the instance on the hypervisor. {{(pid=98952) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 25 04:43:40.498304 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Creating instance directory {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 25 04:43:40.498710 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Creating image(s) Jun 25 04:43:40.499292 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "/opt/stack/data/nova/instances/57cfae71-795b-408e-850f-5293a22274c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:40.499519 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "/opt/stack/data/nova/instances/57cfae71-795b-408e-850f-5293a22274c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:40.500023 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "/opt/stack/data/nova/instances/57cfae71-795b-408e-850f-5293a22274c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:40.500772 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:40.504665 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:40.505870 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:40.525231 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:43:40.575191 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-3e5f6154-1c0b-462b-ab8e-09a254142373 req-1a310aa7-6125-4de4-a1e4-b2125fee62b7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:40.616950 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.111s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:40.617476 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:40.617909 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:40.618575 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:40.622244 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:40.622634 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:40.679164 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-3e5f6154-1c0b-462b-ab8e-09a254142373 req-1a310aa7-6125-4de4-a1e4-b2125fee62b7 service nova] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:43:40.709816 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.087s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:40.710325 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/57cfae71-795b-408e-850f-5293a22274c3/disk 1073741824 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:40.755683 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/57cfae71-795b-408e-850f-5293a22274c3/disk 1073741824" returned: 0 in 0.045s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:40.756276 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.138s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:40.756847 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:40.856140 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.099s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:40.858572 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57cfae71-795b-408e-850f-5293a22274c3/disk. size=1073741824 {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 25 04:43:40.859368 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57cfae71-795b-408e-850f-5293a22274c3/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:40.943669 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-3e5f6154-1c0b-462b-ab8e-09a254142373 req-1a310aa7-6125-4de4-a1e4-b2125fee62b7 service nova] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:40.962313 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57cfae71-795b-408e-850f-5293a22274c3/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:40.962775 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Cannot resize image /opt/stack/data/nova/instances/57cfae71-795b-408e-850f-5293a22274c3/disk to a smaller size. {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 25 04:43:40.963156 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Created local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 25 04:43:40.963418 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Ensure instance console log exists: /opt/stack/data/nova/instances/57cfae71-795b-408e-850f-5293a22274c3/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:43:40.963784 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:40.964011 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:40.964231 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:41.038721 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.079s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:41.042325 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 6.080s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:41.042901 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:43:41.052019 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:43:41.054582 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Claim successful on node np0000003587 Jun 25 04:43:41.103698 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 25 04:43:41.447292 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-3e5f6154-1c0b-462b-ab8e-09a254142373 req-1a310aa7-6125-4de4-a1e4-b2125fee62b7 service nova] Releasing lock "refresh_cache-57cfae71-795b-408e-850f-5293a22274c3" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:43:41.447780 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquired lock "refresh_cache-57cfae71-795b-408e-850f-5293a22274c3" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:43:41.448051 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:43:41.550948 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:43:41.551340 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:43:41.551718 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:41.552890 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:41.696402 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '947bde0e827c45f5bab008d094816d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284d191aa82f453cabcfd18172f74099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:43:41.797726 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquiring lock "8b915629-823e-4b55-bc64-d73e58b79bdc" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:41.798684 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:42.057295 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 25 04:43:42.086234 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:43:42.127212 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Found WWN 330000000864687b3 for multipath device dm-18 {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 25 04:43:42.127673 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.073s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:43:42.128066 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] <== connect_volume: return (6054ms) {'type': 'block', 'scsi_wwn': '330000000864687b3', 'path': '/dev/dm-18', 'multipath_id': '330000000864687b3'} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:43:42.128144 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000864687b3', 'path': '/dev/dm-18', 'multipath_id': '330000000864687b3'} {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 25 04:43:42.129089 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.004s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:43:42.129751 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'} {{(pid=98952) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 25 04:43:42.134493 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lazy-loading 'flavor' on Instance uuid 097ff869-4376-4450-9a31-5389fe5e44c8 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:43:42.148667 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:43:42.149255 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:43:42.149948 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:43:42.151040 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:43:42.151476 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:43:42.152188 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.startup = automatic Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.scan = manual Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.50.100 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:43:42.175264 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.startup = automatic Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.scan = manual Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.40.100 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:43:42.191850 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:42.196824 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:42.211015 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:42.236862 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:42.236862 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:42.236862 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:42.236862 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:42.236862 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:42.236862 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:42.236862 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:42.236862 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:42.236862 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:42.236862 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:42.236862 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:42.236862 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:42.236862 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:42.236862 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:42.236862 np0000003587 nova-compute[98952]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:42.236862 np0000003587 nova-compute[98952]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:42.236862 np0000003587 nova-compute[98952]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37 (non-flash) Jun 25 04:43:42.236862 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:42.236862 np0000003587 nova-compute[98952]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37 (non-flash) Jun 25 04:43:42.236862 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:42.236862 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:42.236862 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:42.236862 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:43:42.238333 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:42.238333 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:42.238333 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:42.238333 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:42.238333 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:42.238333 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:42.238333 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:42.238333 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:42.238333 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:42.238333 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:42.238333 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:42.238333 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:42.238333 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:42.238333 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:42.238333 np0000003587 nova-compute[98952]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:42.238333 np0000003587 nova-compute[98952]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:42.238333 np0000003587 nova-compute[98952]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37 (non-flash) Jun 25 04:43:42.238333 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:42.238333 np0000003587 nova-compute[98952]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37 (non-flash) Jun 25 04:43:42.238333 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:42.238333 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:42.238333 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:42.238333 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:43:42.238333 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.087s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:43:42.238333 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Connected to 192.168.50.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:43:42.239699 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] HCTL ('23', '0', '0', 0) found on session 25 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:43:42.239699 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Scanning host 23 c: 0, t: 0, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:43:42.248387 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:42.248387 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:42.248387 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:42.248387 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:42.248387 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:42.248387 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:42.248387 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:42.248387 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:42.248387 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:42.248387 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:42.248387 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:42.248387 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:42.248387 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:42.248387 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:42.248387 np0000003587 nova-compute[98952]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:42.248387 np0000003587 nova-compute[98952]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:42.248387 np0000003587 nova-compute[98952]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37 (non-flash) Jun 25 04:43:42.248387 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:42.248387 np0000003587 nova-compute[98952]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37 (non-flash) Jun 25 04:43:42.248387 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:42.248387 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:42.248387 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:42.248387 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:43:42.249897 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:42.249897 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:42.249897 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:42.249897 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:42.249897 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:42.249897 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:42.249897 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:42.249897 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:42.249897 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:42.249897 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:42.249897 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:42.249897 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:42.249897 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:42.249897 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:42.249897 np0000003587 nova-compute[98952]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:42.249897 np0000003587 nova-compute[98952]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:42.249897 np0000003587 nova-compute[98952]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37 (non-flash) Jun 25 04:43:42.249897 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:42.249897 np0000003587 nova-compute[98952]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37 (non-flash) Jun 25 04:43:42.249897 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:42.249897 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:42.249897 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:42.249897 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:43:42.249897 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.099s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:43:42.249897 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Connected to 192.168.40.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:43:42.251334 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] HCTL ('24', '0', '0', 0) found on session 26 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:43:42.251334 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Scanning host 24 c: 0, t: 0, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:43:42.254150 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Searching for a device in session 25 and hctl ('23', '0', '0', 0) yield: sdr {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:43:42.254353 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Connected to sdr using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:43:42.270301 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Searching for a device in session 26 and hctl ('24', '0', '0', 0) yield: sds {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:43:42.271148 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Connected to sds using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:43:42.306289 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:43:42.352647 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:42.416888 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Successfully created port: a967a2fd-f804-4a2d-b980-fae0336ab02c {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:43:42.562860 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Start building block device mappings for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 25 04:43:42.590976 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Updating instance_info_cache with network_info: [{"id": "e964866c-f84b-40f3-9766-be7d03de0ccf", "address": "fa:16:3e:cd:9b:6f", "network": {"id": "e6f86cfa-e1c1-4b5f-a202-4fc020faa25c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-929667271-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3904801097947c79fdb5c25d592ac04", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape964866c-f8", "ovs_interfaceid": "e964866c-f84b-40f3-9766-be7d03de0ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:42.638500 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Attempting to attach volume 3672114c-ce91-4feb-b609-ed100a301c37 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98952) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 25 04:43:42.643175 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] attach device xml: Jun 25 04:43:42.643175 np0000003587 nova-compute[98952]: Jun 25 04:43:42.643175 np0000003587 nova-compute[98952]: Jun 25 04:43:42.643175 np0000003587 nova-compute[98952]: Jun 25 04:43:42.643175 np0000003587 nova-compute[98952]: Jun 25 04:43:42.643175 np0000003587 nova-compute[98952]: 3672114c-ce91-4feb-b609-ed100a301c37 Jun 25 04:43:42.643175 np0000003587 nova-compute[98952]: Jun 25 04:43:42.643175 np0000003587 nova-compute[98952]: {{(pid=98952) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 25 04:43:42.885313 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:43.093974 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Releasing lock "refresh_cache-57cfae71-795b-408e-850f-5293a22274c3" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:43:43.095152 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Instance network_info: |[{"id": "e964866c-f84b-40f3-9766-be7d03de0ccf", "address": "fa:16:3e:cd:9b:6f", "network": {"id": "e6f86cfa-e1c1-4b5f-a202-4fc020faa25c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-929667271-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3904801097947c79fdb5c25d592ac04", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape964866c-f8", "ovs_interfaceid": "e964866c-f84b-40f3-9766-be7d03de0ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 25 04:43:43.102628 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Start _get_guest_xml network_info=[{"id": "e964866c-f84b-40f3-9766-be7d03de0ccf", "address": "fa:16:3e:cd:9b:6f", "network": {"id": "e6f86cfa-e1c1-4b5f-a202-4fc020faa25c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-929667271-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3904801097947c79fdb5c25d592ac04", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape964866c-f8", "ovs_interfaceid": "e964866c-f84b-40f3-9766-be7d03de0ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '4ecaf199-c1b9-4ce3-869c-178c170c1662'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:43:43.103395 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:43.116027 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:43:43.117168 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-28148207-1', uuid='57cfae71-795b-408e-850f-5293a22274c3'), owner=OwnerMeta(userid='9089e105690144639fa948de817a4f70', username='tempest-TestMultiAttachVolumeSwap-726937048-project-member', projectid='f3904801097947c79fdb5c25d592ac04', projectname='tempest-TestMultiAttachVolumeSwap-726937048'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e964866c-f84b-40f3-9766-be7d03de0ccf", "address": "fa:16:3e:cd:9b:6f", "network": {"id": "e6f86cfa-e1c1-4b5f-a202-4fc020faa25c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-929667271-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3904801097947c79fdb5c25d592ac04", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape964866c-f8", "ovs_interfaceid": "e964866c-f84b-40f3-9766-be7d03de0ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362623.1167543) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:43:43.120093 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:43:43.120812 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:43:43.123572 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:43:43.123741 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:43:43.125048 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:43:43.125530 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:43:43.125751 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:43:43.125898 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:43:43.126760 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:43:43.126760 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:43:43.127698 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:43:43.127698 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:43:43.127874 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:43:43.128027 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:43:43.129243 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:43:43.129945 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:43:43.147536 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:43:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-28148207-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-testmultiattachvolumeswap-server-28148207-1',id=17,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8HNnRKo9IfMu7lIP1nED6tctJTj+M0ERPyvyAQLjV+ZpMZe/o6fnBbF4Wm9oVUurr7j0KLnSjOWjamdd0hVg+0ItnjF/8xHprMSlOVi8pUp6ZbGD1DgwnfSJpWipWzzQ==',key_name='tempest-keypair-974335318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3904801097947c79fdb5c25d592ac04',ramdisk_id='',reservation_id='r-b6mp0hfb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-726937048',owner_user_name='tempest-TestMultiAttachVolumeSwap-726937048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:43:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9089e105690144639fa948de817a4f70',uuid=57cfae71-795b-408e-850f-5293a22274c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e964866c-f84b-40f3-9766-be7d03de0ccf", "address": "fa:16:3e:cd:9b:6f", "network": {"id": "e6f86cfa-e1c1-4b5f-a202-4fc020faa25c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-929667271-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3904801097947c79fdb5c25d592ac04", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape964866c-f8", "ovs_interfaceid": "e964866c-f84b-40f3-9766-be7d03de0ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:43:43.148592 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Converting VIF {"id": "e964866c-f84b-40f3-9766-be7d03de0ccf", "address": "fa:16:3e:cd:9b:6f", "network": {"id": "e6f86cfa-e1c1-4b5f-a202-4fc020faa25c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-929667271-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3904801097947c79fdb5c25d592ac04", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape964866c-f8", "ovs_interfaceid": "e964866c-f84b-40f3-9766-be7d03de0ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:43.149732 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:9b:6f,bridge_name='br-int',has_traffic_filtering=True,id=e964866c-f84b-40f3-9766-be7d03de0ccf,network=Network(e6f86cfa-e1c1-4b5f-a202-4fc020faa25c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape964866c-f8') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:43.151139 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lazy-loading 'pci_devices' on Instance uuid 57cfae71-795b-408e-850f-5293a22274c3 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:43:43.155463 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 25 04:43:43.356646 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Successfully updated port: a967a2fd-f804-4a2d-b980-fae0336ab02c {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:43:43.439086 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6c736d7d-a0ad-4169-804e-0bcdace06178 req-492b003a-4b27-4a28-b820-7690489ef794 service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Received event network-changed-a967a2fd-f804-4a2d-b980-fae0336ab02c {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:43.439086 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6c736d7d-a0ad-4169-804e-0bcdace06178 req-492b003a-4b27-4a28-b820-7690489ef794 service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Refreshing instance network info cache due to event network-changed-a967a2fd-f804-4a2d-b980-fae0336ab02c. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:43:43.439246 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6c736d7d-a0ad-4169-804e-0bcdace06178 req-492b003a-4b27-4a28-b820-7690489ef794 service nova] Acquiring lock "refresh_cache-520409fb-f97c-4503-b97b-7cecd377102a" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:43:43.439379 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6c736d7d-a0ad-4169-804e-0bcdace06178 req-492b003a-4b27-4a28-b820-7690489ef794 service nova] Acquired lock "refresh_cache-520409fb-f97c-4503-b97b-7cecd377102a" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:43:43.439468 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-6c736d7d-a0ad-4169-804e-0bcdace06178 req-492b003a-4b27-4a28-b820-7690489ef794 service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Refreshing network info cache for port a967a2fd-f804-4a2d-b980-fae0336ab02c {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:43:43.463468 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:43:43.464471 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:43:43.577309 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Start spawning the instance on the hypervisor. {{(pid=98952) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 25 04:43:43.578387 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Creating instance directory {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 25 04:43:43.578735 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Creating image(s) Jun 25 04:43:43.579076 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "/opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:43.579265 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "/opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:43.581508 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "/opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:43.582314 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:43.586164 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:43.587588 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] End _get_guest_xml xml= Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: 57cfae71-795b-408e-850f-5293a22274c3 Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: instance-00000011 Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: 196608 Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: tempest-TestMultiAttachVolumeSwap-server-28148207-1 Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: 2026-06-25 04:43:43 Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: 192 Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: True Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: bare Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: virtio Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: tempest-TestMultiAttachVolumeSwap-726937048-project-member Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: tempest-TestMultiAttachVolumeSwap-726937048 Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: 57cfae71-795b-408e-850f-5293a22274c3 Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: 57cfae71-795b-408e-850f-5293a22274c3 Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: hvm Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: 128 Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: Jun 25 04:43:43.658577 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:43:43.660774 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Preparing to wait for external event network-vif-plugged-e964866c-f84b-40f3-9766-be7d03de0ccf {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:43:43.660774 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "57cfae71-795b-408e-850f-5293a22274c3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:43.660774 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "57cfae71-795b-408e-850f-5293a22274c3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:43.660774 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "57cfae71-795b-408e-850f-5293a22274c3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:43.660774 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:43:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-28148207-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-testmultiattachvolumeswap-server-28148207-1',id=17,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8HNnRKo9IfMu7lIP1nED6tctJTj+M0ERPyvyAQLjV+ZpMZe/o6fnBbF4Wm9oVUurr7j0KLnSjOWjamdd0hVg+0ItnjF/8xHprMSlOVi8pUp6ZbGD1DgwnfSJpWipWzzQ==',key_name='tempest-keypair-974335318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3904801097947c79fdb5c25d592ac04',ramdisk_id='',reservation_id='r-b6mp0hfb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-726937048',owner_user_name='tempest-TestMultiAttachVolumeSwap-726937048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:43:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9089e105690144639fa948de817a4f70',uuid=57cfae71-795b-408e-850f-5293a22274c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e964866c-f84b-40f3-9766-be7d03de0ccf", "address": "fa:16:3e:cd:9b:6f", "network": {"id": "e6f86cfa-e1c1-4b5f-a202-4fc020faa25c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-929667271-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3904801097947c79fdb5c25d592ac04", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape964866c-f8", "ovs_interfaceid": "e964866c-f84b-40f3-9766-be7d03de0ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:43:43.661014 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Converting VIF {"id": "e964866c-f84b-40f3-9766-be7d03de0ccf", "address": "fa:16:3e:cd:9b:6f", "network": {"id": "e6f86cfa-e1c1-4b5f-a202-4fc020faa25c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-929667271-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3904801097947c79fdb5c25d592ac04", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape964866c-f8", "ovs_interfaceid": "e964866c-f84b-40f3-9766-be7d03de0ccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:43.661750 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:9b:6f,bridge_name='br-int',has_traffic_filtering=True,id=e964866c-f84b-40f3-9766-be7d03de0ccf,network=Network(e6f86cfa-e1c1-4b5f-a202-4fc020faa25c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape964866c-f8') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:43.662069 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:9b:6f,bridge_name='br-int',has_traffic_filtering=True,id=e964866c-f84b-40f3-9766-be7d03de0ccf,network=Network(e6f86cfa-e1c1-4b5f-a202-4fc020faa25c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape964866c-f8') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:43:43.662831 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:43.663318 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:43.663975 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:43:43.671040 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:43.671490 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7c4fa525-ad9f-5191-980e-e130d91fa2c9', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:43.672884 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:43.674671 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:43.680811 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.093s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:43.681251 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:43.681703 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:43.682225 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:43.686631 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:43.688069 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:43.688331 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:43.714127 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:43.714902 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape964866c-f8, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:43.715771 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape964866c-f8, col_values=(('qos', UUID('a41791d9-d471-4fdd-b57c-12c67e5a8631')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:43.716107 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape964866c-f8, col_values=(('external_ids', {'iface-id': 'e964866c-f84b-40f3-9766-be7d03de0ccf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:9b:6f', 'vm-uuid': '57cfae71-795b-408e-850f-5293a22274c3'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:43.722256 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:43.725407 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:43.735998 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:43.737522 np0000003587 nova-compute[98952]: INFO os_vif [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:9b:6f,bridge_name='br-int',has_traffic_filtering=True,id=e964866c-f84b-40f3-9766-be7d03de0ccf,network=Network(e6f86cfa-e1c1-4b5f-a202-4fc020faa25c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape964866c-f8') Jun 25 04:43:43.821589 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.133s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:43.823244 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk 1073741824 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:43.861658 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "refresh_cache-520409fb-f97c-4503-b97b-7cecd377102a" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:43:43.891774 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk 1073741824" returned: 0 in 0.069s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:43.892473 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.211s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:43.893176 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:43.944297 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-6c736d7d-a0ad-4169-804e-0bcdace06178 req-492b003a-4b27-4a28-b820-7690489ef794 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:43.969052 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:43:44.009890 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.117s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:44.012076 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Checking if we can resize image /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk. size=1073741824 {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 25 04:43:44.012609 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:44.050945 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-6c736d7d-a0ad-4169-804e-0bcdace06178 req-492b003a-4b27-4a28-b820-7690489ef794 service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:43:44.139626 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:44.141335 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Cannot resize image /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk to a smaller size. {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 25 04:43:44.141831 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Created local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 25 04:43:44.142064 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Ensure instance console log exists: /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:43:44.142413 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:44.142812 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:44.143043 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:44.179732 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Found WWN 330000000908985c8 for multipath device dm-14 {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 25 04:43:44.180249 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.051s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:43:44.180546 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] <== connect_volume: return (5054ms) {'type': 'block', 'scsi_wwn': '330000000908985c8', 'path': '/dev/dm-14', 'multipath_id': '330000000908985c8'} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:43:44.180824 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000908985c8', 'path': '/dev/dm-14', 'multipath_id': '330000000908985c8'} {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 25 04:43:44.249263 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-6c736d7d-a0ad-4169-804e-0bcdace06178 req-492b003a-4b27-4a28-b820-7690489ef794 service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:44.321220 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0011323139999603882 future=) submitted to {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:43:44.321383 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:43:44.322078 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=5.533836733000044 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:43:44.322981 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:44.323091 np0000003587 nova-compute[98952]: INFO nova.compute.manager [-] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] VM Stopped (Lifecycle Event) Jun 25 04:43:44.324354 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=5.5312335000000985 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:43:44.380289 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:43:44.380463 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:43:44.380523 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:43:44.380662 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] No VIF found with MAC fa:16:3e:cc:df:5a, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:43:44.479429 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.440s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:44.481001 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 5.977s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:44.481353 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:43:44.484184 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:44.484432 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Auditing locally available compute resources for np0000003587 (node: np0000003587) {{(pid=98952) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 25 04:43:44.485174 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.601s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:44.488776 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:43:44.490005 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Claim successful on node np0000003587 Jun 25 04:43:44.688737 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:43:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1478758735',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-serverbootfromvolumestablerescuetest-server-1478758735',id=14,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-25T04:43:27Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='a5d52ed3b8de460eb65a8fb4ad1b015d',ramdisk_id='',reservation_id='r-rdate591',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-6878904',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:43:28Z,user_data=None,user_id='27ebe4b23b624995a52b9313ff9e318a',uuid=df96228c-c3b2-457d-9eb1-2e82186076f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "address": "fa:16:3e:e9:03:29", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "vif_mac": "fa:16:3e:e9:03:29"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5c445e-b1", "ovs_interfaceid": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:43:44.689749 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converting VIF {"id": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "address": "fa:16:3e:e9:03:29", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "vif_mac": "fa:16:3e:e9:03:29"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5c445e-b1", "ovs_interfaceid": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:44.689749 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:03:29,bridge_name='br-int',has_traffic_filtering=True,id=2a5c445e-b115-42f3-984d-bfe5af6670e4,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5c445e-b1') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:44.690640 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'pci_devices' on Instance uuid df96228c-c3b2-457d-9eb1-2e82186076f4 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:43:44.751456 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6c736d7d-a0ad-4169-804e-0bcdace06178 req-492b003a-4b27-4a28-b820-7690489ef794 service nova] Releasing lock "refresh_cache-520409fb-f97c-4503-b97b-7cecd377102a" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:43:44.752038 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquired lock "refresh_cache-520409fb-f97c-4503-b97b-7cecd377102a" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:43:44.752230 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:43:44.826012 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-ef704ffe-3720-4905-8cf4-63d126a0a1e2 None None] [instance: 7671d823-fb04-46c9-80d9-e171d8032199] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:44.902519 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:44.991364 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:43:44.991364 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:43:44.991364 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:44.991364 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:45.117610 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9089e105690144639fa948de817a4f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904801097947c79fdb5c25d592ac04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:43:45.193496 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] End _get_guest_xml xml= Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: df96228c-c3b2-457d-9eb1-2e82186076f4 Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: instance-0000000e Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: 196608 Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: tempest-ServerBootFromVolumeStableRescueTest-server-1478758735 Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: 2026-06-25 04:43:38 Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: 192 Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: True Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: bare Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: ide Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: virtio Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: pc Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: virtio Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: virtio Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: virtio Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: tempest-ServerBootFromVolumeStableRescueTest-6878904 Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: df96228c-c3b2-457d-9eb1-2e82186076f4 Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: df96228c-c3b2-457d-9eb1-2e82186076f4 Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: hvm Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: 128 Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: 31e8293d-50f2-4271-8cc5-bdd52f895f6d Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: Jun 25 04:43:45.199130 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:43:45.203164 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Instance destroyed successfully. Jun 25 04:43:45.265726 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:43:45.265726 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:43:45.267480 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] No VIF found with MAC fa:16:3e:cd:9b:6f, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:43:45.267480 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Using config drive Jun 25 04:43:45.350476 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:43:45.495717 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 25 04:43:45.555814 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:45.637498 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:45.666122 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:45.668927 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:45.795143 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:45.800046 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:45.814140 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/097ff869-4376-4450-9a31-5389fe5e44c8/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:45.927245 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/097ff869-4376-4450-9a31-5389fe5e44c8/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:45.928867 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/097ff869-4376-4450-9a31-5389fe5e44c8/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:45.986952 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Successfully created port: b1dad6b2-03a7-4440-a485-a06ce1cc0802 {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:43:46.000057 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Start building block device mappings for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 25 04:43:46.017798 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f0bc96d1-d7bb-4d2e-b825-2d217e30b3d5 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "097ff869-4376-4450-9a31-5389fe5e44c8" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 10.702s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:46.041777 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/097ff869-4376-4450-9a31-5389fe5e44c8/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:46.041777 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] skipping disk /dev/dm-18 (vdb) as it is a volume {{(pid=98952) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 25 04:43:46.046064 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Updating instance_info_cache with network_info: [{"id": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "address": "fa:16:3e:55:5b:09", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa967a2fd-f8", "ovs_interfaceid": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:46.059955 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] skipping disk /dev/dm-6 (vda) as it is a volume {{(pid=98952) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 25 04:43:46.059955 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=98952) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 25 04:43:46.059955 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] skipping disk /dev/dm-5 (vdc) as it is a volume {{(pid=98952) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 25 04:43:46.067024 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19180a23-a7e0-4354-b9f4-9ca57062fc06/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:46.112753 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Creating config drive at /opt/stack/data/nova/instances/57cfae71-795b-408e-850f-5293a22274c3/disk.config Jun 25 04:43:46.120508 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/57cfae71-795b-408e-850f-5293a22274c3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjsjzwvmx {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:46.183215 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/57cfae71-795b-408e-850f-5293a22274c3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjsjzwvmx" returned: 0 in 0.063s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:46.198084 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19180a23-a7e0-4354-b9f4-9ca57062fc06/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:46.201931 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19180a23-a7e0-4354-b9f4-9ca57062fc06/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:46.333206 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19180a23-a7e0-4354-b9f4-9ca57062fc06/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:46.572520 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Releasing lock "refresh_cache-520409fb-f97c-4503-b97b-7cecd377102a" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:43:46.572880 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Instance network_info: |[{"id": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "address": "fa:16:3e:55:5b:09", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa967a2fd-f8", "ovs_interfaceid": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 25 04:43:46.577619 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Start _get_guest_xml network_info=[{"id": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "address": "fa:16:3e:55:5b:09", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa967a2fd-f8", "ovs_interfaceid": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '4ecaf199-c1b9-4ce3-869c-178c170c1662'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:43:46.587545 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:43:46.589535 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='520409fb-f97c-4503-b97b-7cecd377102a'), owner=OwnerMeta(userid='947bde0e827c45f5bab008d094816d8c', username='tempest-AttachVolumeMultiAttachTest-1256899935-project-member', projectid='284d191aa82f453cabcfd18172f74099', projectname='tempest-AttachVolumeMultiAttachTest-1256899935'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "address": "fa:16:3e:55:5b:09", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa967a2fd-f8", "ovs_interfaceid": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362626.5890791) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:43:46.591064 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:43:46.592566 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:43:46.598064 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:43:46.598286 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:43:46.603117 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:43:46.603117 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:43:46.603117 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:43:46.603117 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:43:46.603117 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:43:46.603117 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:43:46.603117 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:43:46.603117 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:43:46.603575 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:43:46.603575 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:43:46.604590 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:43:46.604780 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:43:46.635637 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:43:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='multiattach-server-1',id=19,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV/p3ZeuUk+pDtRyjEqB6LGacp/8M+rMj60nbQpQu7IIRoy9lFRhD1vsgSIFDZ+PjS4ytFpGVQZ3frW+0uH/J+qnA92sFXepo+od7tCOydqRChW2tpsraqZi+iIk6G08A==',key_name='tempest-keypair-462979399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='284d191aa82f453cabcfd18172f74099',ramdisk_id='',reservation_id='r-tn9kc6s5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1256899935',owner_user_name='tempest-AttachVolumeMultiAttachTest-1256899935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:43:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='947bde0e827c45f5bab008d094816d8c',uuid=520409fb-f97c-4503-b97b-7cecd377102a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "address": "fa:16:3e:55:5b:09", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa967a2fd-f8", "ovs_interfaceid": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:43:46.635637 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converting VIF {"id": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "address": "fa:16:3e:55:5b:09", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa967a2fd-f8", "ovs_interfaceid": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:46.635637 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:5b:09,bridge_name='br-int',has_traffic_filtering=True,id=a967a2fd-f804-4a2d-b980-fae0336ab02c,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa967a2fd-f8') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:46.635637 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lazy-loading 'pci_devices' on Instance uuid 520409fb-f97c-4503-b97b-7cecd377102a {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:43:46.662218 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Acquiring lock "097ff869-4376-4450-9a31-5389fe5e44c8" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:46.662449 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "097ff869-4376-4450-9a31-5389fe5e44c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:46.662707 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Acquiring lock "097ff869-4376-4450-9a31-5389fe5e44c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:46.662881 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "097ff869-4376-4450-9a31-5389fe5e44c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:46.663142 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "097ff869-4376-4450-9a31-5389fe5e44c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:46.675468 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Terminating instance Jun 25 04:43:46.749756 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:43:46.749756 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:43:46.750022 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:43:46.751910 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] No VIF found with MAC fa:16:3e:e9:03:29, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:43:46.752810 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Using config drive Jun 25 04:43:46.813874 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:46.871293 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:46.875743 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:46.928840 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Successfully updated port: b1dad6b2-03a7-4440-a485-a06ce1cc0802 {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:43:46.981337 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:47.023983 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Start spawning the instance on the hypervisor. {{(pid=98952) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 25 04:43:47.029844 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-7665204d-6c49-49cb-ba60-250ee98e7607 req-9db20012-3982-413a-85ff-a78daeb81509 service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Received event network-changed-b1dad6b2-03a7-4440-a485-a06ce1cc0802 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:47.030754 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-7665204d-6c49-49cb-ba60-250ee98e7607 req-9db20012-3982-413a-85ff-a78daeb81509 service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Refreshing instance network info cache due to event network-changed-b1dad6b2-03a7-4440-a485-a06ce1cc0802. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:43:47.031027 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-7665204d-6c49-49cb-ba60-250ee98e7607 req-9db20012-3982-413a-85ff-a78daeb81509 service nova] Acquiring lock "refresh_cache-d50f4386-5be2-4ba5-b63f-8cca28d53bbd" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:43:47.031274 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-7665204d-6c49-49cb-ba60-250ee98e7607 req-9db20012-3982-413a-85ff-a78daeb81509 service nova] Acquired lock "refresh_cache-d50f4386-5be2-4ba5-b63f-8cca28d53bbd" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:43:47.031473 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-7665204d-6c49-49cb-ba60-250ee98e7607 req-9db20012-3982-413a-85ff-a78daeb81509 service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Refreshing network info cache for port b1dad6b2-03a7-4440-a485-a06ce1cc0802 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:43:47.033854 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Creating instance directory {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 25 04:43:47.041112 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Creating image(s) Jun 25 04:43:47.044980 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "/opt/stack/data/nova/instances/d50f4386-5be2-4ba5-b63f-8cca28d53bbd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:47.044980 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "/opt/stack/data/nova/instances/d50f4386-5be2-4ba5-b63f-8cca28d53bbd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:47.045220 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "/opt/stack/data/nova/instances/d50f4386-5be2-4ba5-b63f-8cca28d53bbd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:47.045913 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:47.051206 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:47.053214 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:47.071488 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:43:47.072259 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:43:47.085837 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57cfae71-795b-408e-850f-5293a22274c3/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:47.112480 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:43:47.137863 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-0548b6ca-9b87-49e9-b442-ed7135380326 req-85b120b8-6d65-4a55-bc4b-19d8d925cd16 service nova] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Received event network-vif-plugged-e964866c-f84b-40f3-9766-be7d03de0ccf {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:47.137863 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-0548b6ca-9b87-49e9-b442-ed7135380326 req-85b120b8-6d65-4a55-bc4b-19d8d925cd16 service nova] Acquiring lock "57cfae71-795b-408e-850f-5293a22274c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:47.137863 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-0548b6ca-9b87-49e9-b442-ed7135380326 req-85b120b8-6d65-4a55-bc4b-19d8d925cd16 service nova] Lock "57cfae71-795b-408e-850f-5293a22274c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:47.137863 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-0548b6ca-9b87-49e9-b442-ed7135380326 req-85b120b8-6d65-4a55-bc4b-19d8d925cd16 service nova] Lock "57cfae71-795b-408e-850f-5293a22274c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:47.137863 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-0548b6ca-9b87-49e9-b442-ed7135380326 req-85b120b8-6d65-4a55-bc4b-19d8d925cd16 service nova] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Processing event network-vif-plugged-e964866c-f84b-40f3-9766-be7d03de0ccf {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] End _get_guest_xml xml= Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: 520409fb-f97c-4503-b97b-7cecd377102a Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: instance-00000013 Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: 196608 Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: multiattach-server-1 Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: 2026-06-25 04:43:46 Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: 192 Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: True Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: bare Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: virtio Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: tempest-AttachVolumeMultiAttachTest-1256899935-project-member Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: tempest-AttachVolumeMultiAttachTest-1256899935 Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: 520409fb-f97c-4503-b97b-7cecd377102a Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: 520409fb-f97c-4503-b97b-7cecd377102a Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: hvm Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: 128 Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Preparing to wait for external event network-vif-plugged-a967a2fd-f804-4a2d-b980-fae0336ab02c {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "520409fb-f97c-4503-b97b-7cecd377102a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "520409fb-f97c-4503-b97b-7cecd377102a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:47.143519 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "520409fb-f97c-4503-b97b-7cecd377102a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:47.148171 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:43:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='multiattach-server-1',id=19,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV/p3ZeuUk+pDtRyjEqB6LGacp/8M+rMj60nbQpQu7IIRoy9lFRhD1vsgSIFDZ+PjS4ytFpGVQZ3frW+0uH/J+qnA92sFXepo+od7tCOydqRChW2tpsraqZi+iIk6G08A==',key_name='tempest-keypair-462979399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='284d191aa82f453cabcfd18172f74099',ramdisk_id='',reservation_id='r-tn9kc6s5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1256899935',owner_user_name='tempest-AttachVolumeMultiAttachTest-1256899935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:43:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='947bde0e827c45f5bab008d094816d8c',uuid=520409fb-f97c-4503-b97b-7cecd377102a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "address": "fa:16:3e:55:5b:09", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa967a2fd-f8", "ovs_interfaceid": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:43:47.148171 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converting VIF {"id": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "address": "fa:16:3e:55:5b:09", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa967a2fd-f8", "ovs_interfaceid": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:47.148171 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:5b:09,bridge_name='br-int',has_traffic_filtering=True,id=a967a2fd-f804-4a2d-b980-fae0336ab02c,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa967a2fd-f8') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:47.148171 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:5b:09,bridge_name='br-int',has_traffic_filtering=True,id=a967a2fd-f804-4a2d-b980-fae0336ab02c,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa967a2fd-f8') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:43:47.148171 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:47.149790 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:47.150378 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:43:47.154266 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:47.154266 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '875c2cc3-b882-528c-b2d7-e536192fbdc1', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:47.157721 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:47.159113 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:47.160212 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.107s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:47.162605 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:47.162605 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:47.162605 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:47.167333 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:47.168364 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:47.188312 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:47.200389 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Start destroying the instance on the hypervisor. {{(pid=98952) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 25 04:43:47.216168 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:47.216168 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa967a2fd-f8, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:47.216464 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa967a2fd-f8, col_values=(('qos', UUID('440a7535-8fe2-452e-b285-04a6bb50a78f')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:47.217447 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa967a2fd-f8, col_values=(('external_ids', {'iface-id': 'a967a2fd-f804-4a2d-b980-fae0336ab02c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:5b:09', 'vm-uuid': '520409fb-f97c-4503-b97b-7cecd377102a'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:47.221062 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57cfae71-795b-408e-850f-5293a22274c3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:47.222139 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57cfae71-795b-408e-850f-5293a22274c3/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:47.222139 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:47.248728 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:47.264221 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'ec2_ids' on Instance uuid df96228c-c3b2-457d-9eb1-2e82186076f4 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:43:47.271892 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:47.282007 np0000003587 nova-compute[98952]: INFO os_vif [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:5b:09,bridge_name='br-int',has_traffic_filtering=True,id=a967a2fd-f804-4a2d-b980-fae0336ab02c,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa967a2fd-f8') Jun 25 04:43:47.292978 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.125s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:47.295657 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/d50f4386-5be2-4ba5-b63f-8cca28d53bbd/disk 1073741824 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:47.333433 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:47.346849 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57cfae71-795b-408e-850f-5293a22274c3/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:47.351882 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] skipping disk /dev/dm-14 (vda) as it is a volume {{(pid=98952) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 25 04:43:47.352214 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df96228c-c3b2-457d-9eb1-2e82186076f4/disk.rescue --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:47.368226 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/d50f4386-5be2-4ba5-b63f-8cca28d53bbd/disk 1073741824" returned: 0 in 0.074s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:47.368861 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.207s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:47.369411 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:47.382509 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:47.408231 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:47.433136 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "refresh_cache-d50f4386-5be2-4ba5-b63f-8cca28d53bbd" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:43:47.447955 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:47.469933 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df96228c-c3b2-457d-9eb1-2e82186076f4/disk.rescue --force-share --output=json" returned: 0 in 0.117s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:47.470138 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df96228c-c3b2-457d-9eb1-2e82186076f4/disk.rescue --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:47.490303 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.120s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:47.493213 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d50f4386-5be2-4ba5-b63f-8cca28d53bbd/disk. size=1073741824 {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 25 04:43:47.493213 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d50f4386-5be2-4ba5-b63f-8cca28d53bbd/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:47.493573 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:47.538950 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-7665204d-6c49-49cb-ba60-250ee98e7607 req-9db20012-3982-413a-85ff-a78daeb81509 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:47.573682 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:47.583747 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df96228c-c3b2-457d-9eb1-2e82186076f4/disk.rescue --force-share --output=json" returned: 0 in 0.113s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:47.597716 np0000003587 nova-compute[98952]: DEBUG nova.utils [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Queued Task(fn=>, remaining_delay=14.999499553000078 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:43:47.600322 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98952) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 25 04:43:47.608225 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:47.611519 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:47.630773 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Instance destroyed successfully. Jun 25 04:43:47.633684 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:47.649648 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lazy-loading 'resources' on Instance uuid 097ff869-4376-4450-9a31-5389fe5e44c8 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:43:47.650089 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.155s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:47.650976 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d50f4386-5be2-4ba5-b63f-8cca28d53bbd/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:47.651403 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:43:47.654825 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Cannot resize image /opt/stack/data/nova/instances/d50f4386-5be2-4ba5-b63f-8cca28d53bbd/disk to a smaller size. {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 25 04:43:47.655395 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Created local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 25 04:43:47.655843 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Ensure instance console log exists: /opt/stack/data/nova/instances/d50f4386-5be2-4ba5-b63f-8cca28d53bbd/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:43:47.657366 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:47.657366 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:47.657366 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:47.675065 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:47.695018 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-7665204d-6c49-49cb-ba60-250ee98e7607 req-9db20012-3982-413a-85ff-a78daeb81509 service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:43:47.716355 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:47.716821 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:47.779734 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:43:47.780889 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'keypairs' on Instance uuid df96228c-c3b2-457d-9eb1-2e82186076f4 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:43:47.813295 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:47.818754 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:47.910698 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:47.912327 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:47.966069 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-7665204d-6c49-49cb-ba60-250ee98e7607 req-9db20012-3982-413a-85ff-a78daeb81509 service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:48.013584 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:48.019253 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98952) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 25 04:43:48.021934 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:48.092250 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:48.093279 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:43:48.094620 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 57cfae71-795b-408e-850f-5293a22274c3] VM Started (Lifecycle Event) Jun 25 04:43:48.100185 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Guest created on hypervisor {{(pid=98952) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 25 04:43:48.109604 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Instance spawned successfully. Jun 25 04:43:48.109604 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 25 04:43:48.109841 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:48.110328 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:48.156054 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:43:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-727501721',display_name='tempest-DeleteServersTestJSON-server-727501721',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-deleteserverstestjson-server-727501721',id=16,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-25T04:43:28Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='23cc8f804d4d43ca988183143f7c55ac',ramdisk_id='',reservation_id='r-uf80zpa0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-91450344',owner_user_name='tempest-DeleteServersTestJSON-91450344-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:43:29Z,user_data=None,user_id='185eb95c254e401a850b00b6968ac365',uuid=097ff869-4376-4450-9a31-5389fe5e44c8,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32349050-a5cd-4950-b24a-c8c426cfbf07", "address": "fa:16:3e:cc:df:5a", "network": {"id": "8a0f3d27-84d3-4110-8c2e-a1fe33eef085", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1913090721-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23cc8f804d4d43ca988183143f7c55ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32349050-a5", "ovs_interfaceid": "32349050-a5cd-4950-b24a-c8c426cfbf07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:43:48.156692 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Converting VIF {"id": "32349050-a5cd-4950-b24a-c8c426cfbf07", "address": "fa:16:3e:cc:df:5a", "network": {"id": "8a0f3d27-84d3-4110-8c2e-a1fe33eef085", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1913090721-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23cc8f804d4d43ca988183143f7c55ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32349050-a5", "ovs_interfaceid": "32349050-a5cd-4950-b24a-c8c426cfbf07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:48.157576 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:df:5a,bridge_name='br-int',has_traffic_filtering=True,id=32349050-a5cd-4950-b24a-c8c426cfbf07,network=Network(8a0f3d27-84d3-4110-8c2e-a1fe33eef085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32349050-a5') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:48.158192 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:df:5a,bridge_name='br-int',has_traffic_filtering=True,id=32349050-a5cd-4950-b24a-c8c426cfbf07,network=Network(8a0f3d27-84d3-4110-8c2e-a1fe33eef085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32349050-a5') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:43:48.162421 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:48.162621 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32349050-a5, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:48.170586 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:48.170586 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:48.172004 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:43:48.172004 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:43:48.172122 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:48.174321 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:48.185667 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:48.188831 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:48.189624 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f2cb9a7-5e68-4865-bef5-57cebfba492a) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:48.193579 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:48.193579 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:48.211579 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:48.217307 np0000003587 nova-compute[98952]: INFO os_vif [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:df:5a,bridge_name='br-int',has_traffic_filtering=True,id=32349050-a5cd-4950-b24a-c8c426cfbf07,network=Network(8a0f3d27-84d3-4110-8c2e-a1fe33eef085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32349050-a5') Jun 25 04:43:48.220072 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] calling os-brick to detach iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 25 04:43:48.220574 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37', 'iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3672114c-ce91-4feb-b609-ed100a301c37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-18'}, None), 'kwargs': {'force': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:43:48.220911 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:43:48.221573 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:43:48.221977 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37', 'iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3672114c-ce91-4feb-b609-ed100a301c37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-18'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 25 04:43:48.222126 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37', 0)] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 25 04:43:48.222401 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:48.230512 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] skipping disk /dev/dm-9 (vda) as it is a volume {{(pid=98952) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 25 04:43:48.230755 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] skipping disk /dev/dm-12 (vdb) as it is a volume {{(pid=98952) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 25 04:43:48.230906 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] skipping disk /dev/dm-13 (vdc) as it is a volume {{(pid=98952) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 25 04:43:48.233726 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:43:48.237995 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:48.281485 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:48.284517 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Hypervisor/Node resource view: name=np0000003587 free_ram=49651MB free_disk=73.95358276367188GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98952) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 25 04:43:48.284517 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:48.284517 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:48.295599 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:43:48.304370 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5f65ec37e8e4f43aea1ab1bb0aa3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531c29726a504313bae3835b93c9c5eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:43:48.309324 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:48.311839 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:48.311839 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:48.311839 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:48.311839 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:48.311839 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:48.311839 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:48.311839 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:48.311839 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:48.311839 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:48.311839 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:48.311839 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:48.311839 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:48.311839 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:48.311839 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:48.311839 np0000003587 nova-compute[98952]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:48.311839 np0000003587 nova-compute[98952]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:48.311839 np0000003587 nova-compute[98952]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37 (non-flash) Jun 25 04:43:48.311839 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:48.311839 np0000003587 nova-compute[98952]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37 (non-flash) Jun 25 04:43:48.311839 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:48.311839 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:48.311839 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:48.311839 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:43:48.312270 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:48.312270 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:43:48.312270 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:48.312270 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:43:48.312270 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:48.312270 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:43:48.312270 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:48.312270 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:43:48.312270 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:48.312270 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:43:48.312270 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:48.312270 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:43:48.312270 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:48.312270 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:43:48.312270 np0000003587 nova-compute[98952]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:48.312270 np0000003587 nova-compute[98952]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:43:48.312270 np0000003587 nova-compute[98952]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37 (non-flash) Jun 25 04:43:48.312270 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:48.312270 np0000003587 nova-compute[98952]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37 (non-flash) Jun 25 04:43:48.312270 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:43:48.312270 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:48.312270 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:43:48.312270 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:43:48.312805 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', '15'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', '6')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 25 04:43:48.312805 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37', '29')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:43:48.316805 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37', '30')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:43:48.316805 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Resulting device map defaultdict(. at 0x7a16b0159580>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37'): ({'sdv'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37'): ({'sdw'}, set())}) {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 25 04:43:48.317086 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Removing multipathed devices sdv, sdw {{(pid=98952) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 25 04:43:48.317205 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Flush multipath device 330000000864687b3 {{(pid=98952) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 25 04:43:48.360741 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Remove SCSI device /dev/sdv with /sys/block/sdv/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:43:48.424501 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Remove SCSI device /dev/sdw with /sys/block/sdw/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:43:48.472036 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Checking to see if SCSI volumes sdv, sdw have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 25 04:43:48.475614 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] SCSI volumes sdv, sdw have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 25 04:43:48.475614 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-7665204d-6c49-49cb-ba60-250ee98e7607 req-9db20012-3982-413a-85ff-a78daeb81509 service nova] Releasing lock "refresh_cache-d50f4386-5be2-4ba5-b63f-8cca28d53bbd" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:43:48.475898 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquired lock "refresh_cache-d50f4386-5be2-4ba5-b63f-8cca28d53bbd" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:43:48.476671 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:43:48.485595 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Checking to see if device paths {'sdv', 'sdw'} are still under multipathd monitoring {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 25 04:43:48.502216 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Device paths {'sdv', 'sdw'} have been removed from multipathd monitoring. {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 25 04:43:48.502946 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37')] {{(pid=98952) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 25 04:43:48.530277 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Creating config drive at /opt/stack/data/nova/instances/df96228c-c3b2-457d-9eb1-2e82186076f4/disk.config.rescue Jun 25 04:43:48.531215 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:48.535240 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/df96228c-c3b2-457d-9eb1-2e82186076f4/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbkj2l6v5 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:48.597390 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/df96228c-c3b2-457d-9eb1-2e82186076f4/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbkj2l6v5" returned: 0 in 0.062s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:48.598373 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37, portal: 192.168.40.100,3260] Jun 25 04:43:48.598373 np0000003587 nova-compute[98952]: Logout of [sid: 29, target: iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37, portal: 192.168.40.100,3260] successful. Jun 25 04:43:48.598373 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:48.604811 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:48.617050 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:43:48.619716 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Found default for hw_cdrom_bus of ide {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:48.619882 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Found default for hw_disk_bus of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:48.620357 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Found default for hw_input_bus of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:48.620996 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Found default for hw_pointer_model of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:48.621074 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Found default for hw_video_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:48.621396 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Found default for hw_vif_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:48.640135 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:48.657916 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:48.679410 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 25 04:43:48.722952 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37, portal: 192.168.50.100,3260] Jun 25 04:43:48.722952 np0000003587 nova-compute[98952]: Logout of [sid: 30, target: iqn.2023-03.storpool.com:os--volume-3672114c-ce91-4feb-b609-ed100a301c37, portal: 192.168.50.100,3260] successful. Jun 25 04:43:48.722952 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:48.754273 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:43:48.755451 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.533s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:43:48.755451 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] <== disconnect_volume: return (534ms) None {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:43:48.756346 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Disconnected iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 25 04:43:48.756536 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Deleting instance files /opt/stack/data/nova/instances/097ff869-4376-4450-9a31-5389fe5e44c8_del Jun 25 04:43:48.762683 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Deletion of /opt/stack/data/nova/instances/097ff869-4376-4450-9a31-5389fe5e44c8_del complete Jun 25 04:43:48.862952 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:43:48.862952 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:43:48.862952 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No VIF found with MAC fa:16:3e:55:5b:09, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:43:48.862952 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Using config drive Jun 25 04:43:48.995206 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Successfully created port: 4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:43:49.094023 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:43:49.125814 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 57cfae71-795b-408e-850f-5293a22274c3] During sync_power_state the instance has a pending task (spawning). Skip. Jun 25 04:43:49.125920 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Paused> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:49.126461 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 57cfae71-795b-408e-850f-5293a22274c3] VM Paused (Lifecycle Event) Jun 25 04:43:49.131472 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Took 8.63 seconds to spawn the instance on the hypervisor. Jun 25 04:43:49.134380 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:49.193386 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Start building block device mappings for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 25 04:43:49.197366 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:49.230386 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:49.234437 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:49.246926 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-ec063957-2303-41bb-a54b-2c4c946e1db6 req-9c021ce9-5d4e-4758-aa98-99313e9972df service nova] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Received event network-vif-plugged-e964866c-f84b-40f3-9766-be7d03de0ccf {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:49.249030 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ec063957-2303-41bb-a54b-2c4c946e1db6 req-9c021ce9-5d4e-4758-aa98-99313e9972df service nova] Acquiring lock "57cfae71-795b-408e-850f-5293a22274c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:49.249030 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ec063957-2303-41bb-a54b-2c4c946e1db6 req-9c021ce9-5d4e-4758-aa98-99313e9972df service nova] Lock "57cfae71-795b-408e-850f-5293a22274c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.003s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:49.249223 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ec063957-2303-41bb-a54b-2c4c946e1db6 req-9c021ce9-5d4e-4758-aa98-99313e9972df service nova] Lock "57cfae71-795b-408e-850f-5293a22274c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:49.249705 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-ec063957-2303-41bb-a54b-2c4c946e1db6 req-9c021ce9-5d4e-4758-aa98-99313e9972df service nova] [instance: 57cfae71-795b-408e-850f-5293a22274c3] No waiting events found dispatching network-vif-plugged-e964866c-f84b-40f3-9766-be7d03de0ccf {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:43:49.250201 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-ec063957-2303-41bb-a54b-2c4c946e1db6 req-9c021ce9-5d4e-4758-aa98-99313e9972df service nova] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Received unexpected event network-vif-plugged-e964866c-f84b-40f3-9766-be7d03de0ccf for instance with vm_state building and task_state spawning. Jun 25 04:43:49.250201 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-ec063957-2303-41bb-a54b-2c4c946e1db6 req-9c021ce9-5d4e-4758-aa98-99313e9972df service nova] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Received event network-vif-unplugged-32349050-a5cd-4950-b24a-c8c426cfbf07 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:49.251519 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ec063957-2303-41bb-a54b-2c4c946e1db6 req-9c021ce9-5d4e-4758-aa98-99313e9972df service nova] Acquiring lock "097ff869-4376-4450-9a31-5389fe5e44c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:49.251519 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ec063957-2303-41bb-a54b-2c4c946e1db6 req-9c021ce9-5d4e-4758-aa98-99313e9972df service nova] Lock "097ff869-4376-4450-9a31-5389fe5e44c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:49.251519 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ec063957-2303-41bb-a54b-2c4c946e1db6 req-9c021ce9-5d4e-4758-aa98-99313e9972df service nova] Lock "097ff869-4376-4450-9a31-5389fe5e44c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:49.251519 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-ec063957-2303-41bb-a54b-2c4c946e1db6 req-9c021ce9-5d4e-4758-aa98-99313e9972df service nova] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] No waiting events found dispatching network-vif-unplugged-32349050-a5cd-4950-b24a-c8c426cfbf07 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:43:49.251722 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-ec063957-2303-41bb-a54b-2c4c946e1db6 req-9c021ce9-5d4e-4758-aa98-99313e9972df service nova] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Received event network-vif-unplugged-32349050-a5cd-4950-b24a-c8c426cfbf07 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:43:49.256726 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-ec063957-2303-41bb-a54b-2c4c946e1db6 req-9c021ce9-5d4e-4758-aa98-99313e9972df service nova] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Received event network-vif-unplugged-32349050-a5cd-4950-b24a-c8c426cfbf07 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:49.257438 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ec063957-2303-41bb-a54b-2c4c946e1db6 req-9c021ce9-5d4e-4758-aa98-99313e9972df service nova] Acquiring lock "097ff869-4376-4450-9a31-5389fe5e44c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:49.257828 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ec063957-2303-41bb-a54b-2c4c946e1db6 req-9c021ce9-5d4e-4758-aa98-99313e9972df service nova] Lock "097ff869-4376-4450-9a31-5389fe5e44c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:49.258060 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ec063957-2303-41bb-a54b-2c4c946e1db6 req-9c021ce9-5d4e-4758-aa98-99313e9972df service nova] Lock "097ff869-4376-4450-9a31-5389fe5e44c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:49.258256 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-ec063957-2303-41bb-a54b-2c4c946e1db6 req-9c021ce9-5d4e-4758-aa98-99313e9972df service nova] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] No waiting events found dispatching network-vif-unplugged-32349050-a5cd-4950-b24a-c8c426cfbf07 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:43:49.258512 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-ec063957-2303-41bb-a54b-2c4c946e1db6 req-9c021ce9-5d4e-4758-aa98-99313e9972df service nova] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Received event network-vif-unplugged-32349050-a5cd-4950-b24a-c8c426cfbf07 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:43:49.278195 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Took 2.08 seconds to destroy the instance on the hypervisor. Jun 25 04:43:49.279111 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._common.loopingcall [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98952) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 25 04:43:49.279749 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [-] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Deallocating network for instance {{(pid=98952) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 25 04:43:49.279866 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] deallocate_for_instance() {{(pid=98952) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 25 04:43:49.280443 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:49.372464 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:49.425218 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 9c033870-f167-4235-86ff-98005452a16c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:43:49.425335 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 097ff869-4376-4450-9a31-5389fe5e44c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:43:49.425549 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 19180a23-a7e0-4354-b9f4-9ca57062fc06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:43:49.432410 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 520409fb-f97c-4503-b97b-7cecd377102a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:43:49.432410 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:43:49.432410 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 9333a704-82ad-4b54-8456-59eb035a2512 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:43:49.432410 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance ea0f9737-865a-4199-9077-b64e88af15db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:43:49.432410 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:43:49.432410 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 8b915629-823e-4b55-bc64-d73e58b79bdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:43:49.432905 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 11145d6a-7a4f-4b00-8543-d9b51514d9de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:43:49.432905 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 1b412363-2fb7-4469-b748-80cc52825bb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:43:49.432905 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 9aa3370c-9525-460d-b6fc-40a6461bd725 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:43:49.432905 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance df96228c-c3b2-457d-9eb1-2e82186076f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:43:49.432905 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 57cfae71-795b-408e-850f-5293a22274c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:43:49.433183 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance d50f4386-5be2-4ba5-b63f-8cca28d53bbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:43:49.439596 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Total usable vcpus: 16, total allocated vcpus: 15 {{(pid=98952) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 25 04:43:49.442395 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Final resource view: name=np0000003587 phys_ram=64301MB used_ram=3392MB phys_disk=95GB used_disk=10GB total_vcpus=16 used_vcpus=15 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:43:48 up 29 min, 2 users, load average: 11.91, 6.38, 2.89\n', 'num_instances': '15', 'num_vm_active': '11', 'num_task_None': '9', 'num_os_type_None': '15', 'num_proj_a5d52ed3b8de460eb65a8fb4ad1b015d': '4', 'io_workload': '5', 'num_proj_284d191aa82f453cabcfd18172f74099': '5', 'num_proj_1c1a4dead6ad4de1bb75262d9c52bbee': '1', 'num_proj_40a42527a8b24135b741fe2c38dc14b0': '1', 'num_task_rescuing': '1', 'num_task_deleting': '1', 'num_proj_23cc8f804d4d43ca988183143f7c55ac': '1', 'num_vm_building': '4', 'num_task_spawning': '3', 'num_proj_f3904801097947c79fdb5c25d592ac04': '2', 'num_task_networking': '1', 'num_proj_531c29726a504313bae3835b93c9c5eb': '1'} {{(pid=98952) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 25 04:43:49.448543 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:49.469106 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:49.530815 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:49.543207 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:49.554999 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:49.583019 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:49.638286 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:49.645124 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:49.645219 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 57cfae71-795b-408e-850f-5293a22274c3] VM Resumed (Lifecycle Event) Jun 25 04:43:49.662598 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Took 14.87 seconds to build instance. Jun 25 04:43:49.855851 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004486020000058488 future=) submitted to {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:43:49.859803 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Emitting event Stopped> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:49.860438 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] VM Stopped (Lifecycle Event) Jun 25 04:43:49.863887 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:43:49.864092 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=12.733010605000118 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:43:49.864762 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=12.732814901999973 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:43:49.887248 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Creating config drive at /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk.config Jun 25 04:43:49.899047 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8jjcrkjx {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:49.922934 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:49.983293 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8jjcrkjx" returned: 0 in 0.084s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:49.989593 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Updating instance_info_cache with network_info: [{"id": "b1dad6b2-03a7-4440-a485-a06ce1cc0802", "address": "fa:16:3e:48:68:a7", "network": {"id": "e6f86cfa-e1c1-4b5f-a202-4fc020faa25c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-929667271-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3904801097947c79fdb5c25d592ac04", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1dad6b2-03", "ovs_interfaceid": "b1dad6b2-03a7-4440-a485-a06ce1cc0802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:50.155506 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:50.162567 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:43:50.165921 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "57cfae71-795b-408e-850f-5293a22274c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.382s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:50.216750 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-77305f66-0910-4a8f-8160-54b4ee27a248 req-567b6651-fd18-44bd-abd3-14f8948cf50d service nova] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Received event network-vif-deleted-32349050-a5cd-4950-b24a-c8c426cfbf07 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:50.216750 np0000003587 nova-compute[98952]: INFO nova.compute.manager [req-77305f66-0910-4a8f-8160-54b4ee27a248 req-567b6651-fd18-44bd-abd3-14f8948cf50d service nova] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Neutron deleted interface 32349050-a5cd-4950-b24a-c8c426cfbf07; detaching it from the instance and deleting it from the info cache Jun 25 04:43:50.221190 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Start spawning the instance on the hypervisor. {{(pid=98952) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 25 04:43:50.222686 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Creating instance directory {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 25 04:43:50.225616 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Creating image(s) Jun 25 04:43:50.226876 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:50.226876 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "/opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:50.226876 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-77305f66-0910-4a8f-8160-54b4ee27a248 req-567b6651-fd18-44bd-abd3-14f8948cf50d service nova] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Detach interface failed, port_id=32349050-a5cd-4950-b24a-c8c426cfbf07, reason: Instance 097ff869-4376-4450-9a31-5389fe5e44c8 could not be found. {{(pid=98952) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 25 04:43:50.227938 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "/opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:50.227938 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquiring lock "2fbd2e10573676a33e3a85c8def8b25910e011b6" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:50.234936 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "2fbd2e10573676a33e3a85c8def8b25910e011b6" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.005s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:50.265834 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Successfully updated port: 4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:43:50.340036 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-fd9007fe-8cce-4dfd-a9e4-2edbf7406335 req-911d39bd-5e15-40e7-9a2b-64c39fc70818 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Received event network-changed-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:50.340842 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-fd9007fe-8cce-4dfd-a9e4-2edbf7406335 req-911d39bd-5e15-40e7-9a2b-64c39fc70818 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Refreshing instance network info cache due to event network-changed-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:43:50.341124 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-fd9007fe-8cce-4dfd-a9e4-2edbf7406335 req-911d39bd-5e15-40e7-9a2b-64c39fc70818 service nova] Acquiring lock "refresh_cache-8b915629-823e-4b55-bc64-d73e58b79bdc" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:43:50.341287 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-fd9007fe-8cce-4dfd-a9e4-2edbf7406335 req-911d39bd-5e15-40e7-9a2b-64c39fc70818 service nova] Acquired lock "refresh_cache-8b915629-823e-4b55-bc64-d73e58b79bdc" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:43:50.341449 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-fd9007fe-8cce-4dfd-a9e4-2edbf7406335 req-911d39bd-5e15-40e7-9a2b-64c39fc70818 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Refreshing network info cache for port 4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:43:50.373914 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:50.500283 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Releasing lock "refresh_cache-d50f4386-5be2-4ba5-b63f-8cca28d53bbd" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:43:50.500283 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Instance network_info: |[{"id": "b1dad6b2-03a7-4440-a485-a06ce1cc0802", "address": "fa:16:3e:48:68:a7", "network": {"id": "e6f86cfa-e1c1-4b5f-a202-4fc020faa25c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-929667271-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3904801097947c79fdb5c25d592ac04", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1dad6b2-03", "ovs_interfaceid": "b1dad6b2-03a7-4440-a485-a06ce1cc0802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 25 04:43:50.502719 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Start _get_guest_xml network_info=[{"id": "b1dad6b2-03a7-4440-a485-a06ce1cc0802", "address": "fa:16:3e:48:68:a7", "network": {"id": "e6f86cfa-e1c1-4b5f-a202-4fc020faa25c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-929667271-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3904801097947c79fdb5c25d592ac04", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1dad6b2-03", "ovs_interfaceid": "b1dad6b2-03a7-4440-a485-a06ce1cc0802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '4ecaf199-c1b9-4ce3-869c-178c170c1662'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:43:50.510358 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:43:50.517303 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-28148207-2', uuid='d50f4386-5be2-4ba5-b63f-8cca28d53bbd'), owner=OwnerMeta(userid='9089e105690144639fa948de817a4f70', username='tempest-TestMultiAttachVolumeSwap-726937048-project-member', projectid='f3904801097947c79fdb5c25d592ac04', projectname='tempest-TestMultiAttachVolumeSwap-726937048'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b1dad6b2-03a7-4440-a485-a06ce1cc0802", "address": "fa:16:3e:48:68:a7", "network": {"id": "e6f86cfa-e1c1-4b5f-a202-4fc020faa25c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-929667271-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3904801097947c79fdb5c25d592ac04", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1dad6b2-03", "ovs_interfaceid": "b1dad6b2-03a7-4440-a485-a06ce1cc0802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362630.5142715) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:43:50.535965 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:43:50.536190 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:43:50.541980 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:43:50.542194 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:43:50.543593 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:43:50.545355 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:43:50.545355 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:43:50.545355 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:43:50.545355 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:43:50.545355 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:43:50.545355 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:43:50.545355 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:43:50.545355 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:43:50.545734 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:43:50.548219 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:43:50.548842 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:43:50.577706 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:43:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-28148207-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-testmultiattachvolumeswap-server-28148207-2',id=18,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8HNnRKo9IfMu7lIP1nED6tctJTj+M0ERPyvyAQLjV+ZpMZe/o6fnBbF4Wm9oVUurr7j0KLnSjOWjamdd0hVg+0ItnjF/8xHprMSlOVi8pUp6ZbGD1DgwnfSJpWipWzzQ==',key_name='tempest-keypair-974335318',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3904801097947c79fdb5c25d592ac04',ramdisk_id='',reservation_id='r-b6mp0hfb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-726937048',owner_user_name='tempest-TestMultiAttachVolumeSwap-726937048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9089e105690144639fa948de817a4f70',uuid=d50f4386-5be2-4ba5-b63f-8cca28d53bbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1dad6b2-03a7-4440-a485-a06ce1cc0802", "address": "fa:16:3e:48:68:a7", "network": {"id": "e6f86cfa-e1c1-4b5f-a202-4fc020faa25c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-929667271-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3904801097947c79fdb5c25d592ac04", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1dad6b2-03", "ovs_interfaceid": "b1dad6b2-03a7-4440-a485-a06ce1cc0802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:43:50.577706 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Converting VIF {"id": "b1dad6b2-03a7-4440-a485-a06ce1cc0802", "address": "fa:16:3e:48:68:a7", "network": {"id": "e6f86cfa-e1c1-4b5f-a202-4fc020faa25c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-929667271-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3904801097947c79fdb5c25d592ac04", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1dad6b2-03", "ovs_interfaceid": "b1dad6b2-03a7-4440-a485-a06ce1cc0802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:50.580334 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:68:a7,bridge_name='br-int',has_traffic_filtering=True,id=b1dad6b2-03a7-4440-a485-a06ce1cc0802,network=Network(e6f86cfa-e1c1-4b5f-a202-4fc020faa25c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1dad6b2-03') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:50.580334 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lazy-loading 'pci_devices' on Instance uuid d50f4386-5be2-4ba5-b63f-8cca28d53bbd {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:43:50.646254 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:50.712033 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:50.757668 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:50.780398 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquiring lock "refresh_cache-8b915629-823e-4b55-bc64-d73e58b79bdc" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:43:50.847730 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-fd9007fe-8cce-4dfd-a9e4-2edbf7406335 req-911d39bd-5e15-40e7-9a2b-64c39fc70818 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:50.880528 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:50.962570 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:43:50.962570 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:43:50.997079 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-fd9007fe-8cce-4dfd-a9e4-2edbf7406335 req-911d39bd-5e15-40e7-9a2b-64c39fc70818 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:43:51.011035 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:51.015425 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:51.071451 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:51.071644 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] VM Resumed (Lifecycle Event) Jun 25 04:43:51.079199 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-6c55d0ee-5ed7-4c78-8bfd-557babd55c98 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] End _get_guest_xml xml= Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: d50f4386-5be2-4ba5-b63f-8cca28d53bbd Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: instance-00000012 Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: 196608 Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: tempest-TestMultiAttachVolumeSwap-server-28148207-2 Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: 2026-06-25 04:43:50 Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: 192 Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: True Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: bare Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: virtio Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: tempest-TestMultiAttachVolumeSwap-726937048-project-member Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: tempest-TestMultiAttachVolumeSwap-726937048 Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: d50f4386-5be2-4ba5-b63f-8cca28d53bbd Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: d50f4386-5be2-4ba5-b63f-8cca28d53bbd Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: hvm Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: 128 Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: Jun 25 04:43:51.091533 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:43:51.094477 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Preparing to wait for external event network-vif-plugged-b1dad6b2-03a7-4440-a485-a06ce1cc0802 {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:43:51.094477 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:51.094477 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:51.094477 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:51.097779 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:43:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-28148207-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-testmultiattachvolumeswap-server-28148207-2',id=18,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8HNnRKo9IfMu7lIP1nED6tctJTj+M0ERPyvyAQLjV+ZpMZe/o6fnBbF4Wm9oVUurr7j0KLnSjOWjamdd0hVg+0ItnjF/8xHprMSlOVi8pUp6ZbGD1DgwnfSJpWipWzzQ==',key_name='tempest-keypair-974335318',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3904801097947c79fdb5c25d592ac04',ramdisk_id='',reservation_id='r-b6mp0hfb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-726937048',owner_user_name='tempest-TestMultiAttachVolumeSwap-726937048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9089e105690144639fa948de817a4f70',uuid=d50f4386-5be2-4ba5-b63f-8cca28d53bbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1dad6b2-03a7-4440-a485-a06ce1cc0802", "address": "fa:16:3e:48:68:a7", "network": {"id": "e6f86cfa-e1c1-4b5f-a202-4fc020faa25c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-929667271-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3904801097947c79fdb5c25d592ac04", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1dad6b2-03", "ovs_interfaceid": "b1dad6b2-03a7-4440-a485-a06ce1cc0802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:43:51.098249 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Converting VIF {"id": "b1dad6b2-03a7-4440-a485-a06ce1cc0802", "address": "fa:16:3e:48:68:a7", "network": {"id": "e6f86cfa-e1c1-4b5f-a202-4fc020faa25c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-929667271-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3904801097947c79fdb5c25d592ac04", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1dad6b2-03", "ovs_interfaceid": "b1dad6b2-03a7-4440-a485-a06ce1cc0802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:51.101066 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:68:a7,bridge_name='br-int',has_traffic_filtering=True,id=b1dad6b2-03a7-4440-a485-a06ce1cc0802,network=Network(e6f86cfa-e1c1-4b5f-a202-4fc020faa25c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1dad6b2-03') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:51.101524 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:68:a7,bridge_name='br-int',has_traffic_filtering=True,id=b1dad6b2-03a7-4440-a485-a06ce1cc0802,network=Network(e6f86cfa-e1c1-4b5f-a202-4fc020faa25c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1dad6b2-03') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:43:51.105011 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:51.105409 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:51.105700 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:43:51.110065 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:51.110065 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f6853851-0aaa-50a5-9b9a-cf937257639d', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:51.111208 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:51.115873 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:51.120216 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:51.120512 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1dad6b2-03, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:51.121013 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb1dad6b2-03, col_values=(('qos', UUID('86c304c8-12ec-477e-b43e-57a3f95599cc')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:51.121264 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb1dad6b2-03, col_values=(('external_ids', {'iface-id': 'b1dad6b2-03a7-4440-a485-a06ce1cc0802', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:68:a7', 'vm-uuid': 'd50f4386-5be2-4ba5-b63f-8cca28d53bbd'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:51.128923 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:51.130127 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:51.134199 np0000003587 nova-compute[98952]: INFO os_vif [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:68:a7,bridge_name='br-int',has_traffic_filtering=True,id=b1dad6b2-03a7-4440-a485-a06ce1cc0802,network=Network(e6f86cfa-e1c1-4b5f-a202-4fc020faa25c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1dad6b2-03') Jun 25 04:43:51.155255 np0000003587 nova-compute[98952]: INFO nova.compute.manager [-] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Took 1.87 seconds to deallocate network for instance. Jun 25 04:43:51.251630 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:51.263811 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:51.263811 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2fbd2e10573676a33e3a85c8def8b25910e011b6.part --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:51.315351 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-fd9007fe-8cce-4dfd-a9e4-2edbf7406335 req-911d39bd-5e15-40e7-9a2b-64c39fc70818 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:51.363387 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1046dcd6-df92-4741-8199-0b6dc08fd038 req-080bc371-c5e6-47ec-81a2-7505897d768a service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Received event network-vif-plugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:51.364524 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1046dcd6-df92-4741-8199-0b6dc08fd038 req-080bc371-c5e6-47ec-81a2-7505897d768a service nova] Acquiring lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:51.364524 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1046dcd6-df92-4741-8199-0b6dc08fd038 req-080bc371-c5e6-47ec-81a2-7505897d768a service nova] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:51.364524 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1046dcd6-df92-4741-8199-0b6dc08fd038 req-080bc371-c5e6-47ec-81a2-7505897d768a service nova] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:51.365396 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1046dcd6-df92-4741-8199-0b6dc08fd038 req-080bc371-c5e6-47ec-81a2-7505897d768a service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] No waiting events found dispatching network-vif-plugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:43:51.365396 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-1046dcd6-df92-4741-8199-0b6dc08fd038 req-080bc371-c5e6-47ec-81a2-7505897d768a service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Received unexpected event network-vif-plugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 for instance with vm_state rescued and task_state None. Jun 25 04:43:51.365769 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1046dcd6-df92-4741-8199-0b6dc08fd038 req-080bc371-c5e6-47ec-81a2-7505897d768a service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Received event network-vif-plugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:51.365769 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1046dcd6-df92-4741-8199-0b6dc08fd038 req-080bc371-c5e6-47ec-81a2-7505897d768a service nova] Acquiring lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:51.366029 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1046dcd6-df92-4741-8199-0b6dc08fd038 req-080bc371-c5e6-47ec-81a2-7505897d768a service nova] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:51.366029 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1046dcd6-df92-4741-8199-0b6dc08fd038 req-080bc371-c5e6-47ec-81a2-7505897d768a service nova] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:51.366206 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1046dcd6-df92-4741-8199-0b6dc08fd038 req-080bc371-c5e6-47ec-81a2-7505897d768a service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] No waiting events found dispatching network-vif-plugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:43:51.366703 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-1046dcd6-df92-4741-8199-0b6dc08fd038 req-080bc371-c5e6-47ec-81a2-7505897d768a service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Received unexpected event network-vif-plugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 for instance with vm_state rescued and task_state None. Jun 25 04:43:51.399308 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2fbd2e10573676a33e3a85c8def8b25910e011b6.part --force-share --output=json" returned: 0 in 0.135s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:51.400310 np0000003587 nova-compute[98952]: DEBUG nova.virt.images [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] 40ab5d2e-8009-4416-96e0-288079826d15 was qcow2, converting to raw {{(pid=98952) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 25 04:43:51.402169 np0000003587 nova-compute[98952]: DEBUG nova.privsep.utils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98952) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 25 04:43:51.402772 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2fbd2e10573676a33e3a85c8def8b25910e011b6.part /opt/stack/data/nova/instances/_base/2fbd2e10573676a33e3a85c8def8b25910e011b6.converted {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:51.475335 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:43:51.577466 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:51.581481 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:43:51.656686 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2fbd2e10573676a33e3a85c8def8b25910e011b6.part /opt/stack/data/nova/instances/_base/2fbd2e10573676a33e3a85c8def8b25910e011b6.converted" returned: 0 in 0.254s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:51.663489 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2fbd2e10573676a33e3a85c8def8b25910e011b6.converted --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:51.776832 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Took 0.62 seconds to detach 1 volumes for instance. Jun 25 04:43:51.780064 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2fbd2e10573676a33e3a85c8def8b25910e011b6.converted --force-share --output=json" returned: 0 in 0.114s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:51.781704 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "2fbd2e10573676a33e3a85c8def8b25910e011b6" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.548s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:51.782386 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:51.798854 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:51.799981 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2fbd2e10573676a33e3a85c8def8b25910e011b6 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:51.825948 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-fd9007fe-8cce-4dfd-a9e4-2edbf7406335 req-911d39bd-5e15-40e7-9a2b-64c39fc70818 service nova] Releasing lock "refresh_cache-8b915629-823e-4b55-bc64-d73e58b79bdc" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:43:51.830144 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquired lock "refresh_cache-8b915629-823e-4b55-bc64-d73e58b79bdc" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:43:51.830144 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:43:51.908236 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2fbd2e10573676a33e3a85c8def8b25910e011b6 --force-share --output=json" returned: 0 in 0.108s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:51.908361 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquiring lock "2fbd2e10573676a33e3a85c8def8b25910e011b6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:51.909062 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "2fbd2e10573676a33e3a85c8def8b25910e011b6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:51.910681 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:51.915820 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:43:51.916249 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2fbd2e10573676a33e3a85c8def8b25910e011b6 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:51.996789 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Compute_service record updated for np0000003587:np0000003587 {{(pid=98952) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 25 04:43:51.998596 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.716s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:51.998907 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._threading.loopingcall [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 56.00 seconds {{(pid=98952) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 25 04:43:52.023136 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2fbd2e10573676a33e3a85c8def8b25910e011b6 --force-share --output=json" returned: 0 in 0.106s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:52.025911 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2fbd2e10573676a33e3a85c8def8b25910e011b6,backing_fmt=raw /opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc/disk 1073741824 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:52.083317 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2fbd2e10573676a33e3a85c8def8b25910e011b6,backing_fmt=raw /opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc/disk 1073741824" returned: 0 in 0.059s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:52.084329 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "2fbd2e10573676a33e3a85c8def8b25910e011b6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.175s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:52.085149 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2fbd2e10573676a33e3a85c8def8b25910e011b6 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:52.107512 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:52.108471 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] VM Started (Lifecycle Event) Jun 25 04:43:52.195585 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2fbd2e10573676a33e3a85c8def8b25910e011b6 --force-share --output=json" returned: 0 in 0.110s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:52.196141 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc/disk. size=1073741824 {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 25 04:43:52.197055 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:52.301165 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:52.301165 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:52.327414 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:52.328385 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Cannot resize image /opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc/disk to a smaller size. {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 25 04:43:52.328385 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Created local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 25 04:43:52.332208 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Ensure instance console log exists: /opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:43:52.332208 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:52.332208 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:52.332208 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:52.343596 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-785fda4a-8515-4547-962d-198f64fc2c38 req-ebbcd358-0fdc-46fa-b3b1-74652e5df3ac service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Received event network-vif-plugged-a967a2fd-f804-4a2d-b980-fae0336ab02c {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:52.344086 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-785fda4a-8515-4547-962d-198f64fc2c38 req-ebbcd358-0fdc-46fa-b3b1-74652e5df3ac service nova] Acquiring lock "520409fb-f97c-4503-b97b-7cecd377102a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:52.344086 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-785fda4a-8515-4547-962d-198f64fc2c38 req-ebbcd358-0fdc-46fa-b3b1-74652e5df3ac service nova] Lock "520409fb-f97c-4503-b97b-7cecd377102a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:52.344200 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-785fda4a-8515-4547-962d-198f64fc2c38 req-ebbcd358-0fdc-46fa-b3b1-74652e5df3ac service nova] Lock "520409fb-f97c-4503-b97b-7cecd377102a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:52.344624 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-785fda4a-8515-4547-962d-198f64fc2c38 req-ebbcd358-0fdc-46fa-b3b1-74652e5df3ac service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Processing event network-vif-plugged-a967a2fd-f804-4a2d-b980-fae0336ab02c {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:43:52.344698 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-785fda4a-8515-4547-962d-198f64fc2c38 req-ebbcd358-0fdc-46fa-b3b1-74652e5df3ac service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Received event network-vif-plugged-a967a2fd-f804-4a2d-b980-fae0336ab02c {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:52.346605 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-785fda4a-8515-4547-962d-198f64fc2c38 req-ebbcd358-0fdc-46fa-b3b1-74652e5df3ac service nova] Acquiring lock "520409fb-f97c-4503-b97b-7cecd377102a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:52.347257 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-785fda4a-8515-4547-962d-198f64fc2c38 req-ebbcd358-0fdc-46fa-b3b1-74652e5df3ac service nova] Lock "520409fb-f97c-4503-b97b-7cecd377102a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:52.347257 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-785fda4a-8515-4547-962d-198f64fc2c38 req-ebbcd358-0fdc-46fa-b3b1-74652e5df3ac service nova] Lock "520409fb-f97c-4503-b97b-7cecd377102a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:52.347363 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-785fda4a-8515-4547-962d-198f64fc2c38 req-ebbcd358-0fdc-46fa-b3b1-74652e5df3ac service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] No waiting events found dispatching network-vif-plugged-a967a2fd-f804-4a2d-b980-fae0336ab02c {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:43:52.348147 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-785fda4a-8515-4547-962d-198f64fc2c38 req-ebbcd358-0fdc-46fa-b3b1-74652e5df3ac service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Received unexpected event network-vif-plugged-a967a2fd-f804-4a2d-b980-fae0336ab02c for instance with vm_state building and task_state spawning. Jun 25 04:43:52.350311 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:43:52.356665 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Guest created on hypervisor {{(pid=98952) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 25 04:43:52.366831 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Instance spawned successfully. Jun 25 04:43:52.367147 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 25 04:43:52.473533 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:43:52.605407 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Refreshing inventories for resource provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}} Jun 25 04:43:52.614965 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:52.620180 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:43:52.660352 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:43:52.661005 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:43:52.662009 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] No VIF found with MAC fa:16:3e:48:68:a7, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:43:52.662985 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Using config drive Jun 25 04:43:52.704830 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Updating ProviderTree inventory for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 from _refresh_and_get_inventory using data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}} Jun 25 04:43:52.705093 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Updating inventory in ProviderTree for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 with inventory: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jun 25 04:43:52.722202 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:52.793940 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Refreshing aggregate associations for resource provider e72c7643-c1ab-4c4d-a044-2b10e1a98687, aggregates: None {{(pid=98952) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}} Jun 25 04:43:52.878375 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Found default for hw_cdrom_bus of ide {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:52.878375 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Found default for hw_disk_bus of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:52.878634 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Found default for hw_input_bus of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:52.880886 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Found default for hw_pointer_model of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:52.881994 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Found default for hw_video_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:52.881994 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Found default for hw_vif_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:52.890204 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Refreshing trait associations for resource provider e72c7643-c1ab-4c4d-a044-2b10e1a98687, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_SB16,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_ARCH_RISCV64,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ARCH_S390X,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOUND_MODEL_AC97,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ARCH_MIPSEL,COMPUTE_SOUND_MODEL_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_ARCH_X86_64,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_ARCH_AARCH64,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_ARCH_PPC64LE,COMPUTE_ARCH_X86_64,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=98952) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}} Jun 25 04:43:52.959295 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Updating instance_info_cache with network_info: [{"id": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "address": "fa:16:3e:01:4b:19", "network": {"id": "42b56fcf-0521-41b0-90c0-19763fa22d07", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-808831530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "531c29726a504313bae3835b93c9c5eb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea2b8f9-a1", "ovs_interfaceid": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:53.127170 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:53.127299 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] VM Started (Lifecycle Event) Jun 25 04:43:53.177790 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:53.378540 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Creating config drive at /opt/stack/data/nova/instances/d50f4386-5be2-4ba5-b63f-8cca28d53bbd/disk.config Jun 25 04:43:53.382917 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d50f4386-5be2-4ba5-b63f-8cca28d53bbd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp88cg3f0a {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:53.407586 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Took 9.83 seconds to spawn the instance on the hypervisor. Jun 25 04:43:53.408388 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:53.436485 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d50f4386-5be2-4ba5-b63f-8cca28d53bbd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp88cg3f0a" returned: 0 in 0.054s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:53.447622 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-e0532a93-cfcf-40e8-bf41-1cccbb5cb1b8 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Unrescuing Jun 25 04:43:53.448046 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0532a93-cfcf-40e8-bf41-1cccbb5cb1b8 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "refresh_cache-df96228c-c3b2-457d-9eb1-2e82186076f4" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:43:53.448150 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0532a93-cfcf-40e8-bf41-1cccbb5cb1b8 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquired lock "refresh_cache-df96228c-c3b2-457d-9eb1-2e82186076f4" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:43:53.448256 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-e0532a93-cfcf-40e8-bf41-1cccbb5cb1b8 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:43:53.461762 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Releasing lock "refresh_cache-8b915629-823e-4b55-bc64-d73e58b79bdc" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:43:53.462948 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Instance network_info: |[{"id": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "address": "fa:16:3e:01:4b:19", "network": {"id": "42b56fcf-0521-41b0-90c0-19763fa22d07", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-808831530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "531c29726a504313bae3835b93c9c5eb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea2b8f9-a1", "ovs_interfaceid": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 25 04:43:53.465444 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Start _get_guest_xml network_info=[{"id": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "address": "fa:16:3e:01:4b:19", "network": {"id": "42b56fcf-0521-41b0-90c0-19763fa22d07", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-808831530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "531c29726a504313bae3835b93c9c5eb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea2b8f9-a1", "ovs_interfaceid": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:43:38Z,direct_url=,disk_format='qcow2',id=40ab5d2e-8009-4416-96e0-288079826d15,min_disk=0,min_ram=0,name='tempest-scenario-img--1067605681',owner='531c29726a504313bae3835b93c9c5eb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:43:40Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '40ab5d2e-8009-4416-96e0-288079826d15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:43:53.473184 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:43:53.473865 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='40ab5d2e-8009-4416-96e0-288079826d15', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1333554901', uuid='8b915629-823e-4b55-bc64-d73e58b79bdc'), owner=OwnerMeta(userid='b5f65ec37e8e4f43aea1ab1bb0aa3552', username='tempest-TestMinimumBasicScenario-653303651-project-member', projectid='531c29726a504313bae3835b93c9c5eb', projectname='tempest-TestMinimumBasicScenario-653303651'), image=ImageMeta(id='40ab5d2e-8009-4416-96e0-288079826d15', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "address": "fa:16:3e:01:4b:19", "network": {"id": "42b56fcf-0521-41b0-90c0-19763fa22d07", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-808831530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "531c29726a504313bae3835b93c9c5eb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea2b8f9-a1", "ovs_interfaceid": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362633.473373) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:43:53.476332 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:43:53.476966 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:43:53.478990 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:43:53.479329 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:43:53.480709 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:43:53.482297 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:43:38Z,direct_url=,disk_format='qcow2',id=40ab5d2e-8009-4416-96e0-288079826d15,min_disk=0,min_ram=0,name='tempest-scenario-img--1067605681',owner='531c29726a504313bae3835b93c9c5eb',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:43:40Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:43:53.482297 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:43:53.482297 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:43:53.482664 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:43:53.482696 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:43:53.483151 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:43:53.484168 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:43:53.484168 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:43:53.484168 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:43:53.484168 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:43:53.485132 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:43:53.511382 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:43:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1333554901',display_name='tempest-TestMinimumBasicScenario-server-1333554901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-testminimumbasicscenario-server-1333554901',id=20,image_ref='40ab5d2e-8009-4416-96e0-288079826d15',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIMUjcAKLuJ8eQl8//dID0PBJnmyDvj8jV4j3W/51m7kOma0OarvCuVUgOW43HLUNFw2LvTlSfrfcVQOCz1xrYEidkPoXOARpDdyQfAk+vzyNMGN6jSf5rU9xJ0u0BLPg==',key_name='tempest-TestMinimumBasicScenario-1094476213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='531c29726a504313bae3835b93c9c5eb',ramdisk_id='',reservation_id='r-unbq8o10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='40ab5d2e-8009-4416-96e0-288079826d15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-653303651',owner_user_name='tempest-TestMinimumBasicScenario-653303651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:43:49Z,user_data=None,user_id='b5f65ec37e8e4f43aea1ab1bb0aa3552',uuid=8b915629-823e-4b55-bc64-d73e58b79bdc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "address": "fa:16:3e:01:4b:19", "network": {"id": "42b56fcf-0521-41b0-90c0-19763fa22d07", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-808831530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "531c29726a504313bae3835b93c9c5eb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea2b8f9-a1", "ovs_interfaceid": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:43:53.511382 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Converting VIF {"id": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "address": "fa:16:3e:01:4b:19", "network": {"id": "42b56fcf-0521-41b0-90c0-19763fa22d07", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-808831530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "531c29726a504313bae3835b93c9c5eb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea2b8f9-a1", "ovs_interfaceid": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:53.514509 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:4b:19,bridge_name='br-int',has_traffic_filtering=True,id=4ea2b8f9-a162-4e7a-a47a-0683ae39bacf,network=Network(42b56fcf-0521-41b0-90c0-19763fa22d07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea2b8f9-a1') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:53.518589 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b915629-823e-4b55-bc64-d73e58b79bdc {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:43:53.634408 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:53.637907 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:43:53.927753 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Took 19.08 seconds to build instance. Jun 25 04:43:53.955373 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-e0532a93-cfcf-40e8-bf41-1cccbb5cb1b8 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:54.007035 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] End _get_guest_xml xml= Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: 8b915629-823e-4b55-bc64-d73e58b79bdc Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: instance-00000014 Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: 196608 Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: tempest-TestMinimumBasicScenario-server-1333554901 Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: 2026-06-25 04:43:53 Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: 192 Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: True Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: bare Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: 0 Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: tempest-TestMinimumBasicScenario-653303651-project-member Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: tempest-TestMinimumBasicScenario-653303651 Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: 8b915629-823e-4b55-bc64-d73e58b79bdc Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: 8b915629-823e-4b55-bc64-d73e58b79bdc Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: hvm Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: 128 Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: 1 Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: Jun 25 04:43:54.022457 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:43:54.028772 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Preparing to wait for external event network-vif-plugged-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:43:54.028772 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquiring lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:54.028772 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:54.028772 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:54.028772 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:43:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1333554901',display_name='tempest-TestMinimumBasicScenario-server-1333554901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-testminimumbasicscenario-server-1333554901',id=20,image_ref='40ab5d2e-8009-4416-96e0-288079826d15',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIMUjcAKLuJ8eQl8//dID0PBJnmyDvj8jV4j3W/51m7kOma0OarvCuVUgOW43HLUNFw2LvTlSfrfcVQOCz1xrYEidkPoXOARpDdyQfAk+vzyNMGN6jSf5rU9xJ0u0BLPg==',key_name='tempest-TestMinimumBasicScenario-1094476213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='531c29726a504313bae3835b93c9c5eb',ramdisk_id='',reservation_id='r-unbq8o10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='40ab5d2e-8009-4416-96e0-288079826d15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-653303651',owner_user_name='tempest-TestMinimumBasicScenario-653303651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:43:49Z,user_data=None,user_id='b5f65ec37e8e4f43aea1ab1bb0aa3552',uuid=8b915629-823e-4b55-bc64-d73e58b79bdc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "address": "fa:16:3e:01:4b:19", "network": {"id": "42b56fcf-0521-41b0-90c0-19763fa22d07", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-808831530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "531c29726a504313bae3835b93c9c5eb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea2b8f9-a1", "ovs_interfaceid": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:43:54.028772 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Converting VIF {"id": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "address": "fa:16:3e:01:4b:19", "network": {"id": "42b56fcf-0521-41b0-90c0-19763fa22d07", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-808831530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "531c29726a504313bae3835b93c9c5eb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea2b8f9-a1", "ovs_interfaceid": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:43:54.028772 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:4b:19,bridge_name='br-int',has_traffic_filtering=True,id=4ea2b8f9-a162-4e7a-a47a-0683ae39bacf,network=Network(42b56fcf-0521-41b0-90c0-19763fa22d07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea2b8f9-a1') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:43:54.028772 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:4b:19,bridge_name='br-int',has_traffic_filtering=True,id=4ea2b8f9-a162-4e7a-a47a-0683ae39bacf,network=Network(42b56fcf-0521-41b0-90c0-19763fa22d07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea2b8f9-a1') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:43:54.028772 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:54.028772 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:54.028772 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:43:54.030583 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:54.030583 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c59ba82a-e1ac-5a1d-ab23-0b3623b2f12b', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:54.036158 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:54.036923 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:54.041595 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:54.052696 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:54.060593 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:43:54.060593 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:43:54.063475 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:54.063745 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ea2b8f9-a1, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:54.064962 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ea2b8f9-a1, col_values=(('qos', UUID('b6a65b13-cc32-4b44-8ddf-2cb991325729')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:54.065692 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ea2b8f9-a1, col_values=(('external_ids', {'iface-id': '4ea2b8f9-a162-4e7a-a47a-0683ae39bacf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:4b:19', 'vm-uuid': '8b915629-823e-4b55-bc64-d73e58b79bdc'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:43:54.067297 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:54.069631 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:43:54.078396 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:54.079967 np0000003587 nova-compute[98952]: INFO os_vif [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:4b:19,bridge_name='br-int',has_traffic_filtering=True,id=4ea2b8f9-a162-4e7a-a47a-0683ae39bacf,network=Network(42b56fcf-0521-41b0-90c0-19763fa22d07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea2b8f9-a1') Jun 25 04:43:54.140460 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Paused> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:54.140893 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] VM Paused (Lifecycle Event) Jun 25 04:43:54.164584 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:54.230102 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:54.238612 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:54.245627 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-48d895dc-aef8-4860-b036-0cab19a00f5e req-ee681250-ed75-41f0-883f-dd57f93bf1f2 service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Received event network-vif-plugged-b1dad6b2-03a7-4440-a485-a06ce1cc0802 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:54.245812 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-48d895dc-aef8-4860-b036-0cab19a00f5e req-ee681250-ed75-41f0-883f-dd57f93bf1f2 service nova] Acquiring lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:54.246067 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-48d895dc-aef8-4860-b036-0cab19a00f5e req-ee681250-ed75-41f0-883f-dd57f93bf1f2 service nova] Lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:54.246257 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-48d895dc-aef8-4860-b036-0cab19a00f5e req-ee681250-ed75-41f0-883f-dd57f93bf1f2 service nova] Lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:54.246385 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-48d895dc-aef8-4860-b036-0cab19a00f5e req-ee681250-ed75-41f0-883f-dd57f93bf1f2 service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Processing event network-vif-plugged-b1dad6b2-03a7-4440-a485-a06ce1cc0802 {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:43:54.431743 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-e0532a93-cfcf-40e8-bf41-1cccbb5cb1b8 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:54.435065 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "520409fb-f97c-4503-b97b-7cecd377102a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 20.604s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:54.566048 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:43:54.615265 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-e0532a93-cfcf-40e8-bf41-1cccbb5cb1b8 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Updating instance_info_cache with network_info: [{"id": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "address": "fa:16:3e:e9:03:29", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5c445e-b1", "ovs_interfaceid": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:54.644710 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:54.649934 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:54.650220 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] VM Resumed (Lifecycle Event) Jun 25 04:43:54.906977 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:55.052656 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:43:55.055613 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Guest created on hypervisor {{(pid=98952) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 25 04:43:55.062708 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Instance spawned successfully. Jun 25 04:43:55.062708 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 25 04:43:55.072899 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.772s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:55.119256 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0532a93-cfcf-40e8-bf41-1cccbb5cb1b8 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Releasing lock "refresh_cache-df96228c-c3b2-457d-9eb1-2e82186076f4" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:43:55.120606 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-e0532a93-cfcf-40e8-bf41-1cccbb5cb1b8 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'flavor' on Instance uuid df96228c-c3b2-457d-9eb1-2e82186076f4 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:43:55.144571 np0000003587 nova-compute[98952]: INFO nova.scheduler.client.report [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Deleted allocations for instance 097ff869-4376-4450-9a31-5389fe5e44c8 Jun 25 04:43:55.154063 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:55.156957 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:43:55.570846 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Found default for hw_cdrom_bus of ide {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:55.570846 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Found default for hw_disk_bus of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:55.570846 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Found default for hw_input_bus of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:55.570846 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Found default for hw_pointer_model of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:55.570846 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Found default for hw_video_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:55.570846 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Found default for hw_vif_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:55.609160 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:43:55.609374 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:43:55.609514 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] No VIF found with MAC fa:16:3e:01:4b:19, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:43:55.609989 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Using config drive Jun 25 04:43:55.661780 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:55.661948 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] VM Started (Lifecycle Event) Jun 25 04:43:55.674266 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:55.677782 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:55.705617 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:55.744963 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-e6dcb747-34b1-4f9c-8eba-99020ef2e76d req-b1badfc7-be84-4c0d-9229-31ba8f8ad269 service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Received event network-changed-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:55.744963 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-e6dcb747-34b1-4f9c-8eba-99020ef2e76d req-b1badfc7-be84-4c0d-9229-31ba8f8ad269 service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Refreshing instance network info cache due to event network-changed-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:43:55.744963 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-e6dcb747-34b1-4f9c-8eba-99020ef2e76d req-b1badfc7-be84-4c0d-9229-31ba8f8ad269 service nova] Acquiring lock "refresh_cache-ea0f9737-865a-4199-9077-b64e88af15db" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:43:55.744963 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-e6dcb747-34b1-4f9c-8eba-99020ef2e76d req-b1badfc7-be84-4c0d-9229-31ba8f8ad269 service nova] Acquired lock "refresh_cache-ea0f9737-865a-4199-9077-b64e88af15db" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:43:55.744963 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-e6dcb747-34b1-4f9c-8eba-99020ef2e76d req-b1badfc7-be84-4c0d-9229-31ba8f8ad269 service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Refreshing network info cache for port a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:43:55.883624 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:55.895970 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:55.945091 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:55.966507 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:55.985911 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Instance destroyed successfully. Jun 25 04:43:55.986516 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-e0532a93-cfcf-40e8-bf41-1cccbb5cb1b8 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'numa_topology' on Instance uuid df96228c-c3b2-457d-9eb1-2e82186076f4 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:43:56.079144 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Took 9.05 seconds to spawn the instance on the hypervisor. Jun 25 04:43:56.079313 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:56.118352 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:56.157858 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1204c9e8-1b78-4c25-80a0-4c8deeeccff4 tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Lock "097ff869-4376-4450-9a31-5389fe5e44c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 9.495s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:56.165215 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:56.166547 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:43:56.249240 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-e6dcb747-34b1-4f9c-8eba-99020ef2e76d req-b1badfc7-be84-4c0d-9229-31ba8f8ad269 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:56.302695 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Creating config drive at /opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc/disk.config Jun 25 04:43:56.309127 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbeyb9iy8 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:43:56.361266 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbeyb9iy8" returned: 0 in 0.052s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:43:56.481855 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-7846c879-e13f-465d-9145-6116996c44dd req-a8d0c797-48d4-4638-910a-ccf33e17641b service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Received event network-vif-plugged-b1dad6b2-03a7-4440-a485-a06ce1cc0802 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:56.482085 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-7846c879-e13f-465d-9145-6116996c44dd req-a8d0c797-48d4-4638-910a-ccf33e17641b service nova] Acquiring lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:56.484884 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-7846c879-e13f-465d-9145-6116996c44dd req-a8d0c797-48d4-4638-910a-ccf33e17641b service nova] Lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:56.484884 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-7846c879-e13f-465d-9145-6116996c44dd req-a8d0c797-48d4-4638-910a-ccf33e17641b service nova] Lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:56.484884 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-7846c879-e13f-465d-9145-6116996c44dd req-a8d0c797-48d4-4638-910a-ccf33e17641b service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] No waiting events found dispatching network-vif-plugged-b1dad6b2-03a7-4440-a485-a06ce1cc0802 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:43:56.484884 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-7846c879-e13f-465d-9145-6116996c44dd req-a8d0c797-48d4-4638-910a-ccf33e17641b service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Received unexpected event network-vif-plugged-b1dad6b2-03a7-4440-a485-a06ce1cc0802 for instance with vm_state active and task_state None. Jun 25 04:43:56.484884 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-7846c879-e13f-465d-9145-6116996c44dd req-a8d0c797-48d4-4638-910a-ccf33e17641b service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Received event network-vif-unplugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:56.484884 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-7846c879-e13f-465d-9145-6116996c44dd req-a8d0c797-48d4-4638-910a-ccf33e17641b service nova] Acquiring lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:56.484884 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-7846c879-e13f-465d-9145-6116996c44dd req-a8d0c797-48d4-4638-910a-ccf33e17641b service nova] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:56.484884 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-7846c879-e13f-465d-9145-6116996c44dd req-a8d0c797-48d4-4638-910a-ccf33e17641b service nova] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:56.484884 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-7846c879-e13f-465d-9145-6116996c44dd req-a8d0c797-48d4-4638-910a-ccf33e17641b service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] No waiting events found dispatching network-vif-unplugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:43:56.484884 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-7846c879-e13f-465d-9145-6116996c44dd req-a8d0c797-48d4-4638-910a-ccf33e17641b service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Received unexpected event network-vif-unplugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 for instance with vm_state rescued and task_state unrescuing. Jun 25 04:43:56.489652 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-e0532a93-cfcf-40e8-bf41-1cccbb5cb1b8 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Object Instance lazy-loaded attributes: flavor,numa_topology {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:43:56.593444 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Took 21.74 seconds to build instance. Jun 25 04:43:56.671915 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Paused> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:56.671915 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] VM Paused (Lifecycle Event) Jun 25 04:43:56.722036 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-e6dcb747-34b1-4f9c-8eba-99020ef2e76d req-b1badfc7-be84-4c0d-9229-31ba8f8ad269 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:56.976615 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-e6dcb747-34b1-4f9c-8eba-99020ef2e76d req-b1badfc7-be84-4c0d-9229-31ba8f8ad269 service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Updated VIF entry in instance network info cache for port a68140e2-5c7f-49c9-abbb-fbc11cf20cf2. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:43:56.977748 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-e6dcb747-34b1-4f9c-8eba-99020ef2e76d req-b1badfc7-be84-4c0d-9229-31ba8f8ad269 service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Updating instance_info_cache with network_info: [{"id": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "address": "fa:16:3e:57:c0:7f", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa68140e2-5c", "ovs_interfaceid": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:57.097031 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-39b606bc-aedf-40ac-80b9-48b9504b9ccb tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 23.259s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:57.175782 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:57.180438 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:57.180605 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] VM Resumed (Lifecycle Event) Jun 25 04:43:57.279772 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:57.330952 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:57.420613 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:57.456716 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:57.474209 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:57.483187 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-e6dcb747-34b1-4f9c-8eba-99020ef2e76d req-b1badfc7-be84-4c0d-9229-31ba8f8ad269 service nova] Releasing lock "refresh_cache-ea0f9737-865a-4199-9077-b64e88af15db" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:43:57.583123 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:57.684073 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:57.687440 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:43:57.719342 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "ea0f9737-865a-4199-9077-b64e88af15db" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:57.719519 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "ea0f9737-865a-4199-9077-b64e88af15db" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:57.727755 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:57.825347 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:57.828126 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:57.833443 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:57.854050 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-83aa5e90-c4e1-43c8-b49c-a26d2b1fee1f req-6985de7b-129c-451c-93cf-36bb6ddcc3af service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Received event network-changed-a967a2fd-f804-4a2d-b980-fae0336ab02c {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:57.854050 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-83aa5e90-c4e1-43c8-b49c-a26d2b1fee1f req-6985de7b-129c-451c-93cf-36bb6ddcc3af service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Refreshing instance network info cache due to event network-changed-a967a2fd-f804-4a2d-b980-fae0336ab02c. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:43:57.854760 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-83aa5e90-c4e1-43c8-b49c-a26d2b1fee1f req-6985de7b-129c-451c-93cf-36bb6ddcc3af service nova] Acquiring lock "refresh_cache-520409fb-f97c-4503-b97b-7cecd377102a" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:43:57.854760 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-83aa5e90-c4e1-43c8-b49c-a26d2b1fee1f req-6985de7b-129c-451c-93cf-36bb6ddcc3af service nova] Acquired lock "refresh_cache-520409fb-f97c-4503-b97b-7cecd377102a" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:43:57.855339 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-83aa5e90-c4e1-43c8-b49c-a26d2b1fee1f req-6985de7b-129c-451c-93cf-36bb6ddcc3af service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Refreshing network info cache for port a967a2fd-f804-4a2d-b980-fae0336ab02c {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:43:57.866191 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:58.190946 np0000003587 nova-compute[98952]: DEBUG nova.utils [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Queued Task(fn=>, remaining_delay=14.999726384000041 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:43:58.230545 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lazy-loading 'flavor' on Instance uuid ea0f9737-865a-4199-9077-b64e88af15db {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:43:58.231050 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:58.357873 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-83aa5e90-c4e1-43c8-b49c-a26d2b1fee1f req-6985de7b-129c-451c-93cf-36bb6ddcc3af service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:58.421120 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6c7db93c-fe5d-4c02-ae6a-3134b80eef3f req-270740f5-b91a-4f3b-b597-95eeddd67f4b service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Received event network-changed-b1dad6b2-03a7-4440-a485-a06ce1cc0802 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:58.421296 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6c7db93c-fe5d-4c02-ae6a-3134b80eef3f req-270740f5-b91a-4f3b-b597-95eeddd67f4b service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Refreshing instance network info cache due to event network-changed-b1dad6b2-03a7-4440-a485-a06ce1cc0802. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:43:58.423030 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6c7db93c-fe5d-4c02-ae6a-3134b80eef3f req-270740f5-b91a-4f3b-b597-95eeddd67f4b service nova] Acquiring lock "refresh_cache-d50f4386-5be2-4ba5-b63f-8cca28d53bbd" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:43:58.423030 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6c7db93c-fe5d-4c02-ae6a-3134b80eef3f req-270740f5-b91a-4f3b-b597-95eeddd67f4b service nova] Acquired lock "refresh_cache-d50f4386-5be2-4ba5-b63f-8cca28d53bbd" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:43:58.423030 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-6c7db93c-fe5d-4c02-ae6a-3134b80eef3f req-270740f5-b91a-4f3b-b597-95eeddd67f4b service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Refreshing network info cache for port b1dad6b2-03a7-4440-a485-a06ce1cc0802 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:43:58.582216 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Received event network-vif-unplugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:58.582465 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] Acquiring lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:58.582691 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:58.582847 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:58.583522 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] No waiting events found dispatching network-vif-unplugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:43:58.583872 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Received unexpected event network-vif-unplugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 for instance with vm_state rescued and task_state unrescuing. Jun 25 04:43:58.584038 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Received event network-vif-plugged-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:58.587585 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] Acquiring lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:58.587585 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:58.587585 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:58.587585 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Processing event network-vif-plugged-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:43:58.587585 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Received event network-vif-plugged-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:58.587585 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] Acquiring lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:58.587585 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:58.587585 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:58.587585 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] No waiting events found dispatching network-vif-plugged-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:43:58.587585 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Received unexpected event network-vif-plugged-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf for instance with vm_state building and task_state spawning. Jun 25 04:43:58.587585 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Received event network-vif-plugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:58.587585 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] Acquiring lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:58.587585 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:58.587585 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:58.587585 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] No waiting events found dispatching network-vif-plugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:43:58.587585 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Received unexpected event network-vif-plugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 for instance with vm_state rescued and task_state unrescuing. Jun 25 04:43:58.587585 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Received event network-vif-plugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:43:58.587585 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] Acquiring lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:43:58.588726 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:43:58.588726 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:58.588726 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] No waiting events found dispatching network-vif-plugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:43:58.588726 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-2bca9644-e4c0-47d2-a4b3-7a6ac7af4425 req-4cf65ed2-62cd-4b55-9d2e-3aff54303bcf service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Received unexpected event network-vif-plugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 for instance with vm_state rescued and task_state unrescuing. Jun 25 04:43:58.786457 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-83aa5e90-c4e1-43c8-b49c-a26d2b1fee1f req-6985de7b-129c-451c-93cf-36bb6ddcc3af service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:58.858236 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:43:58.860038 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:58.860214 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] VM Started (Lifecycle Event) Jun 25 04:43:58.866668 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Guest created on hypervisor {{(pid=98952) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 25 04:43:58.868468 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Instance spawned successfully. Jun 25 04:43:58.869431 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 25 04:43:58.873615 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-e0532a93-cfcf-40e8-bf41-1cccbb5cb1b8 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:58.925529 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-6c7db93c-fe5d-4c02-ae6a-3134b80eef3f req-270740f5-b91a-4f3b-b597-95eeddd67f4b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:59.035980 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-83aa5e90-c4e1-43c8-b49c-a26d2b1fee1f req-6985de7b-129c-451c-93cf-36bb6ddcc3af service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Updated VIF entry in instance network info cache for port a967a2fd-f804-4a2d-b980-fae0336ab02c. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:43:59.037419 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-83aa5e90-c4e1-43c8-b49c-a26d2b1fee1f req-6985de7b-129c-451c-93cf-36bb6ddcc3af service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Updating instance_info_cache with network_info: [{"id": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "address": "fa:16:3e:55:5b:09", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa967a2fd-f8", "ovs_interfaceid": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:59.066986 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:43:59.249314 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "ea0f9737-865a-4199-9077-b64e88af15db" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.529s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:43:59.365682 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:59.366996 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:43:59.381011 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Found default for hw_cdrom_bus of ide {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:59.386472 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-6c7db93c-fe5d-4c02-ae6a-3134b80eef3f req-270740f5-b91a-4f3b-b597-95eeddd67f4b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:43:59.389746 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Found default for hw_disk_bus of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:59.389924 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Found default for hw_input_bus of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:59.390271 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Found default for hw_pointer_model of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:59.390690 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Found default for hw_video_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:59.395264 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Found default for hw_vif_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:43:59.545581 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-83aa5e90-c4e1-43c8-b49c-a26d2b1fee1f req-6985de7b-129c-451c-93cf-36bb6ddcc3af service nova] Releasing lock "refresh_cache-520409fb-f97c-4503-b97b-7cecd377102a" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:43:59.602825 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-6c7db93c-fe5d-4c02-ae6a-3134b80eef3f req-270740f5-b91a-4f3b-b597-95eeddd67f4b service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Updated VIF entry in instance network info cache for port b1dad6b2-03a7-4440-a485-a06ce1cc0802. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:43:59.603272 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-6c7db93c-fe5d-4c02-ae6a-3134b80eef3f req-270740f5-b91a-4f3b-b597-95eeddd67f4b service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Updating instance_info_cache with network_info: [{"id": "b1dad6b2-03a7-4440-a485-a06ce1cc0802", "address": "fa:16:3e:48:68:a7", "network": {"id": "e6f86cfa-e1c1-4b5f-a202-4fc020faa25c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-929667271-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3904801097947c79fdb5c25d592ac04", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1dad6b2-03", "ovs_interfaceid": "b1dad6b2-03a7-4440-a485-a06ce1cc0802", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:43:59.871086 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] During sync_power_state the instance has a pending task (spawning). Skip. Jun 25 04:43:59.871728 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Paused> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:43:59.871728 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] VM Paused (Lifecycle Event) Jun 25 04:43:59.918189 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Took 9.70 seconds to spawn the instance on the hypervisor. Jun 25 04:43:59.918189 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:43:59.940475 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:00.108179 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6c7db93c-fe5d-4c02-ae6a-3134b80eef3f req-270740f5-b91a-4f3b-b597-95eeddd67f4b service nova] Releasing lock "refresh_cache-d50f4386-5be2-4ba5-b63f-8cca28d53bbd" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:44:00.375827 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:44:00.379401 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:44:00.379584 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] VM Resumed (Lifecycle Event) Jun 25 04:44:00.410413 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "ea0f9737-865a-4199-9077-b64e88af15db" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:00.410620 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "ea0f9737-865a-4199-9077-b64e88af15db" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:00.413368 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Attaching volume 89748225-9d41-4fb1-b47a-f0f88aa6ebfa to /dev/vdb Jun 25 04:44:00.450166 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Took 17.64 seconds to build instance. Jun 25 04:44:00.509092 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.80', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003587', 'execute': None}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:44:00.515987 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "df96228c-c3b2-457d-9eb1-2e82186076f4" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:00.516187 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:00.516386 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:00.518231 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:00.518231 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:00.521615 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Terminating instance Jun 25 04:44:00.528124 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.scaleio [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98952) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 25 04:44:00.558419 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): nvme version {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:00.609258 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] 'nvme version' failed. Not Retrying. {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 04:44:00.609533 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] nvme not present on system {{(pid=98952) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 25 04:44:00.624415 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98952) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 25 04:44:00.629796 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.lightos [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Current host hostNQN and IP(s) are ['10.4.3.80', 'fe80::f816:3eff:feea:dfe4', '192.168.40.6', 'fe80::f816:3eff:fe4f:7c42', '192.168.50.6', 'fe80::f816:3eff:fe6c:e6a6', '192.168.10.6', 'fe80::f816:3eff:fe17:d749', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::b035:28ff:fe70:6f4a', 'fe80::fc16:3eff:fe8c:f883', 'fe80::483f:f2ff:fe48:75ca', 'fe80::fc16:3eff:fe78:7ac8', 'fe80::1038:1dff:fe1c:d44b', 'fe80::fc16:3eff:fe3a:4858', 'fe80::fc16:3eff:fe4f:4083', 'fe80::fc16:3eff:fee6:e022', 'fe80::fc16:3eff:feab:c3d8', 'fe80::bca6:aaff:fef0:a5cf', 'fe80::fc16:3eff:fe6d:cc4e', 'fe80::fc16:3eff:fe07:d0f0', 'fe80::fc16:3eff:fee6:936b', 'fe80::fc16:3eff:fed3:389d', 'fe80::fc16:3eff:fe06:1da0', 'fe80::6086:d2ff:fe1e:62e1', 'fe80::fc16:3eff:fefe:a095', 'fe80::b4c2:93ff:fe6e:4d89', 'fe80::fc16:3eff:feee:97a2', 'fe80::fc16:3eff:fe57:c07f', 'fe80::fc16:3eff:fecc:30bf', 'fe80::fc16:3eff:feaa:4f74', 'fe80::d0a9:65ff:fe25:9a79', 'fe80::fc16:3eff:fe42:3aef', 'fe80::fc16:3eff:fee8:baea', 'fe80::fc16:3eff:fea7:57df', 'fe80::fc16:3eff:fefa:997d', 'fe80::f404:33ff:febc:fb62', 'fe80::fc16:3eff:fe95:908b', 'fe80::ac3e:37ff:fede:535d', 'fe80::fc16:3eff:fecd:9b6f', 'fe80::7cf5:c7ff:fe12:d4dc', 'fe80::fc16:3eff:fe55:5b09', 'fe80::fc16:3eff:fe48:68a7', 'fe80::fc16:3eff:fe01:4b19', 'fe80::fc16:3eff:fee9:329', 'fe80::c096:18ff:fe44:3261'] Jun 25 04:44:00.629796 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 25 04:44:00.629796 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] LIGHTOS: no hostnqn found. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 25 04:44:00.629796 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.80', 'host': 'np0000003587', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c81886224652', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a1feb13-40e2-4ac6-989e-b08a6fc0f283', 'nvme_native_multipath': False} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:44:00.630406 np0000003587 nova-compute[98952]: DEBUG nova.virt.block_device [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Updating existing volume attachment record: d0c3c6d0-b785-444b-8713-c61133c072e7 {{(pid=98952) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 25 04:44:00.886873 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:44:00.893624 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:44:00.956582 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 19.155s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:01.028680 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Start destroying the instance on the hypervisor. {{(pid=98952) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 25 04:44:01.074897 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:01.087638 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:01.113305 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:01.237731 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Calling os-brick to attach iSCSI Volume {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 25 04:44:01.241889 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:44:01.242117 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:01.242578 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:01.243641 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 25 04:44:01.289713 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:01.291457 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:01.291457 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:44:01.297932 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:01.299033 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:01.299249 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:44:01.318465 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:44:01.318465 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:01.331862 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:44:01.331862 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:01.364637 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa] added Jun 25 04:44:01.364637 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:44:01.364637 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:44:01.364637 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:44:01.364637 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:44:01.364637 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:44:01.364637 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:01.364637 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:44:01.364637 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0703(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:44:01.364637 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:44:01.386747 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa] added Jun 25 04:44:01.386747 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:44:01.386747 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:44:01.386747 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:44:01.386747 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:44:01.386747 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:44:01.386747 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:01.386747 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:44:01.386747 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0855(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:44:01.386747 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:44:01.398312 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Removed pending STOPPED event for df96228c-c3b2-457d-9eb1-2e82186076f4 due to new event Resumed> {{(pid=98952) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 25 04:44:01.398312 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:44:01.398312 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] VM Resumed (Lifecycle Event) Jun 25 04:44:01.415391 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:01.418755 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:01.436979 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:01.458881 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Instance destroyed successfully. Jun 25 04:44:01.462642 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'resources' on Instance uuid df96228c-c3b2-457d-9eb1-2e82186076f4 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:44:01.479586 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-b6397840-fed5-4d8e-802f-d44e628fb2f6 req-6cc2ccab-3886-4406-8991-8f8ce50860bf service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Received event network-vif-unplugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:01.479867 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b6397840-fed5-4d8e-802f-d44e628fb2f6 req-6cc2ccab-3886-4406-8991-8f8ce50860bf service nova] Acquiring lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:01.480088 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b6397840-fed5-4d8e-802f-d44e628fb2f6 req-6cc2ccab-3886-4406-8991-8f8ce50860bf service nova] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:01.481462 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b6397840-fed5-4d8e-802f-d44e628fb2f6 req-6cc2ccab-3886-4406-8991-8f8ce50860bf service nova] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:01.481462 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-b6397840-fed5-4d8e-802f-d44e628fb2f6 req-6cc2ccab-3886-4406-8991-8f8ce50860bf service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] No waiting events found dispatching network-vif-unplugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:01.481462 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-b6397840-fed5-4d8e-802f-d44e628fb2f6 req-6cc2ccab-3886-4406-8991-8f8ce50860bf service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Received event network-vif-unplugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:01.556039 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:01.556439 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "9c033870-f167-4235-86ff-98005452a16c" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:01.556717 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:01.556982 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:01.557636 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:01.562168 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Terminating instance Jun 25 04:44:01.907332 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:44:01.912770 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:44:01.912770 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] VM Started (Lifecycle Event) Jun 25 04:44:01.974971 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:43:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1478758735',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-serverbootfromvolumestablerescuetest-server-1478758735',id=14,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-25T04:43:51Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='a5d52ed3b8de460eb65a8fb4ad1b015d',ramdisk_id='',reservation_id='r-rdate591',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-6878904',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:43:59Z,user_data=None,user_id='27ebe4b23b624995a52b9313ff9e318a',uuid=df96228c-c3b2-457d-9eb1-2e82186076f4,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "address": "fa:16:3e:e9:03:29", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5c445e-b1", "ovs_interfaceid": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:44:01.974971 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converting VIF {"id": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "address": "fa:16:3e:e9:03:29", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5c445e-b1", "ovs_interfaceid": "2a5c445e-b115-42f3-984d-bfe5af6670e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:01.976412 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:03:29,bridge_name='br-int',has_traffic_filtering=True,id=2a5c445e-b115-42f3-984d-bfe5af6670e4,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5c445e-b1') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:01.976997 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:03:29,bridge_name='br-int',has_traffic_filtering=True,id=2a5c445e-b115-42f3-984d-bfe5af6670e4,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5c445e-b1') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:44:01.979305 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:01.979835 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a5c445e-b1, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:01.981416 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:01.983889 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:01.985730 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:01.986406 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dce5fa2f-dd95-4ad2-817a-f7c522baaf15) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:01.986887 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:01.987690 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:01.990916 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:01.994287 np0000003587 nova-compute[98952]: INFO os_vif [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:03:29,bridge_name='br-int',has_traffic_filtering=True,id=2a5c445e-b115-42f3-984d-bfe5af6670e4,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5c445e-b1') Jun 25 04:44:01.996195 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] calling os-brick to detach iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 25 04:44:01.996538 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, None), 'kwargs': {'force': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:44:01.996987 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:02.071271 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Start destroying the instance on the hypervisor. {{(pid=98952) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 25 04:44:02.103502 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:02.117742 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:02.150397 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:02.170614 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:02.196084 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:02.246139 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:02.262390 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:02.369253 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:44:02.388924 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.40.100 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:44:02.403334 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:02.411577 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:02.415074 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:44:02.416007 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:02.432591 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-c73df1bd-2e2f-4e2e-96d3-6c28a540aebc req-69b60b0e-7d2b-4a06-8d8a-67f962ea1efa service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-e12da27e-2953-4784-80b6-5f7204f4e399 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:02.432591 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-c73df1bd-2e2f-4e2e-96d3-6c28a540aebc req-69b60b0e-7d2b-4a06-8d8a-67f962ea1efa service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:02.432591 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-c73df1bd-2e2f-4e2e-96d3-6c28a540aebc req-69b60b0e-7d2b-4a06-8d8a-67f962ea1efa service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:02.434929 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-c73df1bd-2e2f-4e2e-96d3-6c28a540aebc req-69b60b0e-7d2b-4a06-8d8a-67f962ea1efa service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:02.435402 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-c73df1bd-2e2f-4e2e-96d3-6c28a540aebc req-69b60b0e-7d2b-4a06-8d8a-67f962ea1efa service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] No waiting events found dispatching network-vif-unplugged-e12da27e-2953-4784-80b6-5f7204f4e399 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:02.435402 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-c73df1bd-2e2f-4e2e-96d3-6c28a540aebc req-69b60b0e-7d2b-4a06-8d8a-67f962ea1efa service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-e12da27e-2953-4784-80b6-5f7204f4e399 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:02.438245 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:02.438624 np0000003587 nova-compute[98952]: DEBUG nova.utils [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Queued Task(fn=>, remaining_delay=14.999721883999882 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:02.438624 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.50.100 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:44:02.455088 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:02.477149 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:02.481218 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:02.490026 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:02.564488 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:02.568154 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:02.599753 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:02.599753 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.001799894999976459 future=) submitted to {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:02.599753 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:02.599753 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=10.591519180999967 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:02.599753 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=10.591403937999985 future=) was cancelled while queued, skipping {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:02.599753 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:02.599753 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.838707621999902 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:02.599753 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.838606624000022 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:02.601192 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Emitting event Stopped> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:44:02.601192 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] VM Stopped (Lifecycle Event) Jun 25 04:44:02.671583 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:02.681413 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa, portal: 192.168.50.100,3260] Jun 25 04:44:02.681413 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa, portal: 192.168.50.100,3260] successful. Jun 25 04:44:02.681413 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:02.705818 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:02.720267 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:02.761379 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:02.783860 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-84caea39-6289-4a11-ac5f-2f9f84c7e84f req-7eefab25-867e-43fe-a1df-0e0dcb8322b7 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-aa227a29-8d0b-49f2-a71e-233ba6d38b79 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:02.783860 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-84caea39-6289-4a11-ac5f-2f9f84c7e84f req-7eefab25-867e-43fe-a1df-0e0dcb8322b7 service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:02.784022 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-84caea39-6289-4a11-ac5f-2f9f84c7e84f req-7eefab25-867e-43fe-a1df-0e0dcb8322b7 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-84caea39-6289-4a11-ac5f-2f9f84c7e84f req-7eefab25-867e-43fe-a1df-0e0dcb8322b7 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-84caea39-6289-4a11-ac5f-2f9f84c7e84f req-7eefab25-867e-43fe-a1df-0e0dcb8322b7 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] No waiting events found dispatching network-vif-unplugged-aa227a29-8d0b-49f2-a71e-233ba6d38b79 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-84caea39-6289-4a11-ac5f-2f9f84c7e84f req-7eefab25-867e-43fe-a1df-0e0dcb8322b7 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-aa227a29-8d0b-49f2-a71e-233ba6d38b79 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.494s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:02.793509 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to 192.168.50.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:44:02.805485 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] HCTL ('27', '-', '-', 0) found on session 33 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:44:02.806089 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Scanning host 27 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:44:02.818385 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-065cc797-d991-477e-b6ad-4bbd98d3aa9c req-9336f13d-c44c-4ca9-b2ad-5b466bd08c8a service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-4d1f24c3-d7a8-450a-92d5-0e807355b791 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:02.818667 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-065cc797-d991-477e-b6ad-4bbd98d3aa9c req-9336f13d-c44c-4ca9-b2ad-5b466bd08c8a service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:02.821673 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-065cc797-d991-477e-b6ad-4bbd98d3aa9c req-9336f13d-c44c-4ca9-b2ad-5b466bd08c8a service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:02.821673 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-065cc797-d991-477e-b6ad-4bbd98d3aa9c req-9336f13d-c44c-4ca9-b2ad-5b466bd08c8a service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:02.821673 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-065cc797-d991-477e-b6ad-4bbd98d3aa9c req-9336f13d-c44c-4ca9-b2ad-5b466bd08c8a service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] No waiting events found dispatching network-vif-unplugged-4d1f24c3-d7a8-450a-92d5-0e807355b791 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:02.821673 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-065cc797-d991-477e-b6ad-4bbd98d3aa9c req-9336f13d-c44c-4ca9-b2ad-5b466bd08c8a service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-4d1f24c3-d7a8-450a-92d5-0e807355b791 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:02.854730 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching for a device in session 33 and hctl ['27', '*', '*', 0] yield: None {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:44:02.897191 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:02.951239 np0000003587 nova-compute[98952]: DEBUG nova.utils [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Queued Task(fn=>, remaining_delay=14.999723839000126 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:02.967527 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:02.972940 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 9c033870-f167-4235-86ff-98005452a16c] Instance destroyed successfully. Jun 25 04:44:02.974140 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lazy-loading 'resources' on Instance uuid 9c033870-f167-4235-86ff-98005452a16c {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:44:03.106502 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 097ff869-4376-4450-9a31-5389fe5e44c8] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:44:03.267529 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquiring lock "8b915629-823e-4b55-bc64-d73e58b79bdc" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:03.267529 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:03.479702 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1434404356',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-1434404356',id=8,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5fI7yNY+vtWfP6sAEqW81Ob/M0+caqTNEaqf66GbJOFzQ10yeZKXCZkAEA1454wRog9bgRijpgzGKf9EXrMHobXUkpq6fgIwY7w+jABzxBMefwpq8P4Wvi0vvmcHxoKQ==',key_name='tempest-keypair-1601168903',keypairs=,launch_index=0,launched_at=2026-06-25T04:42:50Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='1c1a4dead6ad4de1bb75262d9c52bbee',ramdisk_id='',reservation_id='r-gtp0jtk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-479660225',owner_user_name='tempest-TaggedBootDevicesTest_v242-479660225-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be344ec982ae4676b6a89325d3578d73',uuid=9c033870-f167-4235-86ff-98005452a16c,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e12da27e-2953-4784-80b6-5f7204f4e399", "address": "fa:16:3e:ab:c3:d8", "network": {"id": "179999b1-f8ab-4073-96b7-da830d110303", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1298382094-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape12da27e-29", "ovs_interfaceid": "e12da27e-2953-4784-80b6-5f7204f4e399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:44:03.479702 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converting VIF {"id": "e12da27e-2953-4784-80b6-5f7204f4e399", "address": "fa:16:3e:ab:c3:d8", "network": {"id": "179999b1-f8ab-4073-96b7-da830d110303", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1298382094-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape12da27e-29", "ovs_interfaceid": "e12da27e-2953-4784-80b6-5f7204f4e399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:03.480325 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:c3:d8,bridge_name='br-int',has_traffic_filtering=True,id=e12da27e-2953-4784-80b6-5f7204f4e399,network=Network(179999b1-f8ab-4073-96b7-da830d110303),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape12da27e-29') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:03.480622 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:c3:d8,bridge_name='br-int',has_traffic_filtering=True,id=e12da27e-2953-4784-80b6-5f7204f4e399,network=Network(179999b1-f8ab-4073-96b7-da830d110303),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape12da27e-29') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:44:03.484858 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.484858 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape12da27e-29, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:03.498705 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.502118 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:03.556080 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.556080 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.556080 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=583af2f7-fb10-4708-b957-1ebc85ee0f78) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:03.556080 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.556080 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:03.598763 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-74612034-162f-4cfa-99bb-76b00bbe8bcb req-1e6b81fb-954a-48c5-8f42-b4ba8e9bf778 service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Received event network-vif-unplugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:03.598763 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-74612034-162f-4cfa-99bb-76b00bbe8bcb req-1e6b81fb-954a-48c5-8f42-b4ba8e9bf778 service nova] Acquiring lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:03.598763 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-74612034-162f-4cfa-99bb-76b00bbe8bcb req-1e6b81fb-954a-48c5-8f42-b4ba8e9bf778 service nova] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:03.598763 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-74612034-162f-4cfa-99bb-76b00bbe8bcb req-1e6b81fb-954a-48c5-8f42-b4ba8e9bf778 service nova] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:03.598763 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-74612034-162f-4cfa-99bb-76b00bbe8bcb req-1e6b81fb-954a-48c5-8f42-b4ba8e9bf778 service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] No waiting events found dispatching network-vif-unplugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:03.598763 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-74612034-162f-4cfa-99bb-76b00bbe8bcb req-1e6b81fb-954a-48c5-8f42-b4ba8e9bf778 service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Received event network-vif-unplugged-2a5c445e-b115-42f3-984d-bfe5af6670e4 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:03.607033 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.607033 np0000003587 nova-compute[98952]: INFO os_vif [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:c3:d8,bridge_name='br-int',has_traffic_filtering=True,id=e12da27e-2953-4784-80b6-5f7204f4e399,network=Network(179999b1-f8ab-4073-96b7-da830d110303),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape12da27e-29') Jun 25 04:44:03.607033 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1434404356',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-1434404356',id=8,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5fI7yNY+vtWfP6sAEqW81Ob/M0+caqTNEaqf66GbJOFzQ10yeZKXCZkAEA1454wRog9bgRijpgzGKf9EXrMHobXUkpq6fgIwY7w+jABzxBMefwpq8P4Wvi0vvmcHxoKQ==',key_name='tempest-keypair-1601168903',keypairs=,launch_index=0,launched_at=2026-06-25T04:42:50Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='1c1a4dead6ad4de1bb75262d9c52bbee',ramdisk_id='',reservation_id='r-gtp0jtk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-479660225',owner_user_name='tempest-TaggedBootDevicesTest_v242-479660225-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be344ec982ae4676b6a89325d3578d73',uuid=9c033870-f167-4235-86ff-98005452a16c,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e8846aa-559c-48a1-bf9a-ab431fd380ed", "address": "fa:16:3e:6d:cc:4e", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8846aa-55", "ovs_interfaceid": "7e8846aa-559c-48a1-bf9a-ab431fd380ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:44:03.607033 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converting VIF {"id": "7e8846aa-559c-48a1-bf9a-ab431fd380ed", "address": "fa:16:3e:6d:cc:4e", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8846aa-55", "ovs_interfaceid": "7e8846aa-559c-48a1-bf9a-ab431fd380ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:03.607033 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:cc:4e,bridge_name='br-int',has_traffic_filtering=True,id=7e8846aa-559c-48a1-bf9a-ab431fd380ed,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e8846aa-55') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:03.607033 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:cc:4e,bridge_name='br-int',has_traffic_filtering=True,id=7e8846aa-559c-48a1-bf9a-ab431fd380ed,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e8846aa-55') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:44:03.607033 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.607033 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e8846aa-55, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:03.613973 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.613973 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:03.645159 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.646679 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.646679 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f14cb82f-920a-466f-8d82-cbbdd7e66f86) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:03.653612 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.653612 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:03.688159 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa, portal: 192.168.40.100,3260] Jun 25 04:44:03.688159 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa, portal: 192.168.40.100,3260] successful. Jun 25 04:44:03.688159 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:03.719876 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:03.737674 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.740698 np0000003587 nova-compute[98952]: INFO os_vif [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:cc:4e,bridge_name='br-int',has_traffic_filtering=True,id=7e8846aa-559c-48a1-bf9a-ab431fd380ed,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e8846aa-55') Jun 25 04:44:03.742023 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1434404356',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-1434404356',id=8,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5fI7yNY+vtWfP6sAEqW81Ob/M0+caqTNEaqf66GbJOFzQ10yeZKXCZkAEA1454wRog9bgRijpgzGKf9EXrMHobXUkpq6fgIwY7w+jABzxBMefwpq8P4Wvi0vvmcHxoKQ==',key_name='tempest-keypair-1601168903',keypairs=,launch_index=0,launched_at=2026-06-25T04:42:50Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='1c1a4dead6ad4de1bb75262d9c52bbee',ramdisk_id='',reservation_id='r-gtp0jtk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-479660225',owner_user_name='tempest-TaggedBootDevicesTest_v242-479660225-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be344ec982ae4676b6a89325d3578d73',uuid=9c033870-f167-4235-86ff-98005452a16c,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d1f24c3-d7a8-450a-92d5-0e807355b791", "address": "fa:16:3e:07:d0:f0", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1f24c3-d7", "ovs_interfaceid": "4d1f24c3-d7a8-450a-92d5-0e807355b791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:44:03.742227 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converting VIF {"id": "4d1f24c3-d7a8-450a-92d5-0e807355b791", "address": "fa:16:3e:07:d0:f0", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d1f24c3-d7", "ovs_interfaceid": "4d1f24c3-d7a8-450a-92d5-0e807355b791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:03.742891 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:d0:f0,bridge_name='br-int',has_traffic_filtering=True,id=4d1f24c3-d7a8-450a-92d5-0e807355b791,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d1f24c3-d7') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:03.744151 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:d0:f0,bridge_name='br-int',has_traffic_filtering=True,id=4d1f24c3-d7a8-450a-92d5-0e807355b791,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d1f24c3-d7') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:44:03.744654 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.745072 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d1f24c3-d7, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:03.746493 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.748112 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:03.758987 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:44:03.758987 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:44:03.758987 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:03.758987 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:03.758987 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:03.758987 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:03.758987 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:03.758987 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:03.758987 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:03.758987 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:03.758987 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:03.758987 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:03.758987 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:44:03.758987 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:44:03.758987 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:03.758987 np0000003587 nova-compute[98952]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:03.758987 np0000003587 nova-compute[98952]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:03.758987 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:03.758987 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:03.758987 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:03.758987 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:03.758987 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:03.758987 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:03.760232 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:44:03.760232 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:44:03.760232 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:03.760232 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:03.760232 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:03.760232 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:03.760232 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:03.760232 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:03.760232 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:03.760232 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:03.760232 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:03.760232 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:03.760232 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:44:03.760232 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:44:03.760232 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:03.760232 np0000003587 nova-compute[98952]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:03.760232 np0000003587 nova-compute[98952]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:03.760232 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:03.760232 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:03.760232 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:03.760232 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:03.760232 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:03.760232 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:03.760232 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.469s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:03.760232 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to 192.168.40.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:44:03.762931 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] HCTL ('28', '-', '-', 0) found on session 34 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:44:03.763264 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Scanning host 28 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:44:03.777148 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.780408 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lazy-loading 'flavor' on Instance uuid 8b915629-823e-4b55-bc64-d73e58b79bdc {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:44:03.782263 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.782428 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb1b6a5a-a3d5-4ce5-af0d-e05434e179b0) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:03.784074 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.784667 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:03.795834 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching for a device in session 34 and hctl ['28', '*', '*', 0] yield: sdw {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:44:03.795834 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to sdw using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:44:03.818071 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.820356 np0000003587 nova-compute[98952]: INFO os_vif [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:d0:f0,bridge_name='br-int',has_traffic_filtering=True,id=4d1f24c3-d7a8-450a-92d5-0e807355b791,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d1f24c3-d7') Jun 25 04:44:03.824862 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1434404356',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-1434404356',id=8,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5fI7yNY+vtWfP6sAEqW81Ob/M0+caqTNEaqf66GbJOFzQ10yeZKXCZkAEA1454wRog9bgRijpgzGKf9EXrMHobXUkpq6fgIwY7w+jABzxBMefwpq8P4Wvi0vvmcHxoKQ==',key_name='tempest-keypair-1601168903',keypairs=,launch_index=0,launched_at=2026-06-25T04:42:50Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='1c1a4dead6ad4de1bb75262d9c52bbee',ramdisk_id='',reservation_id='r-gtp0jtk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-479660225',owner_user_name='tempest-TaggedBootDevicesTest_v242-479660225-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be344ec982ae4676b6a89325d3578d73',uuid=9c033870-f167-4235-86ff-98005452a16c,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "789bf2ca-f86e-403a-88a3-0103291a84df", "address": "fa:16:3e:e6:93:6b", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap789bf2ca-f8", "ovs_interfaceid": "789bf2ca-f86e-403a-88a3-0103291a84df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:44:03.824862 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converting VIF {"id": "789bf2ca-f86e-403a-88a3-0103291a84df", "address": "fa:16:3e:e6:93:6b", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap789bf2ca-f8", "ovs_interfaceid": "789bf2ca-f86e-403a-88a3-0103291a84df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:03.824862 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:93:6b,bridge_name='br-int',has_traffic_filtering=True,id=789bf2ca-f86e-403a-88a3-0103291a84df,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap789bf2ca-f8') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:03.824862 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:93:6b,bridge_name='br-int',has_traffic_filtering=True,id=789bf2ca-f86e-403a-88a3-0103291a84df,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap789bf2ca-f8') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:44:03.828147 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.828147 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap789bf2ca-f8, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:03.828465 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.830074 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:03.857622 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching for a device in session 33 and hctl ['27', '*', '*', 0] yield: sdv {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:44:03.857622 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to sdv using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:44:03.861066 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.863331 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.863692 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2243be27-b43d-4b6b-a824-c05ac910668f) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:03.864492 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.864846 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:03.890737 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.895405 np0000003587 nova-compute[98952]: INFO os_vif [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:93:6b,bridge_name='br-int',has_traffic_filtering=True,id=789bf2ca-f86e-403a-88a3-0103291a84df,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap789bf2ca-f8') Jun 25 04:44:03.896374 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1434404356',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-1434404356',id=8,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5fI7yNY+vtWfP6sAEqW81Ob/M0+caqTNEaqf66GbJOFzQ10yeZKXCZkAEA1454wRog9bgRijpgzGKf9EXrMHobXUkpq6fgIwY7w+jABzxBMefwpq8P4Wvi0vvmcHxoKQ==',key_name='tempest-keypair-1601168903',keypairs=,launch_index=0,launched_at=2026-06-25T04:42:50Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='1c1a4dead6ad4de1bb75262d9c52bbee',ramdisk_id='',reservation_id='r-gtp0jtk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-479660225',owner_user_name='tempest-TaggedBootDevicesTest_v242-479660225-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be344ec982ae4676b6a89325d3578d73',uuid=9c033870-f167-4235-86ff-98005452a16c,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa227a29-8d0b-49f2-a71e-233ba6d38b79", "address": "fa:16:3e:d3:38:9d", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa227a29-8d", "ovs_interfaceid": "aa227a29-8d0b-49f2-a71e-233ba6d38b79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:44:03.896659 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converting VIF {"id": "aa227a29-8d0b-49f2-a71e-233ba6d38b79", "address": "fa:16:3e:d3:38:9d", "network": {"id": "f57a28b4-25d5-4ed6-8098-595827156c35", "bridge": "br-int", "label": "tempest-device-tagging-net1-1602953290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa227a29-8d", "ovs_interfaceid": "aa227a29-8d0b-49f2-a71e-233ba6d38b79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:03.898143 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:38:9d,bridge_name='br-int',has_traffic_filtering=True,id=aa227a29-8d0b-49f2-a71e-233ba6d38b79,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa227a29-8d') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:03.898347 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:38:9d,bridge_name='br-int',has_traffic_filtering=True,id=aa227a29-8d0b-49f2-a71e-233ba6d38b79,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa227a29-8d') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:44:03.899784 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.900086 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa227a29-8d, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:03.903277 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.903277 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:03.919141 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.922218 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.922218 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4246a76c-b97c-49b8-b28d-7a8e30c70ac9) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:03.923879 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.923879 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:03.938922 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.941239 np0000003587 nova-compute[98952]: INFO os_vif [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:38:9d,bridge_name='br-int',has_traffic_filtering=True,id=aa227a29-8d0b-49f2-a71e-233ba6d38b79,network=Network(f57a28b4-25d5-4ed6-8098-595827156c35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa227a29-8d') Jun 25 04:44:03.942208 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1434404356',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-1434404356',id=8,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5fI7yNY+vtWfP6sAEqW81Ob/M0+caqTNEaqf66GbJOFzQ10yeZKXCZkAEA1454wRog9bgRijpgzGKf9EXrMHobXUkpq6fgIwY7w+jABzxBMefwpq8P4Wvi0vvmcHxoKQ==',key_name='tempest-keypair-1601168903',keypairs=,launch_index=0,launched_at=2026-06-25T04:42:50Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='1c1a4dead6ad4de1bb75262d9c52bbee',ramdisk_id='',reservation_id='r-gtp0jtk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-479660225',owner_user_name='tempest-TaggedBootDevicesTest_v242-479660225-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be344ec982ae4676b6a89325d3578d73',uuid=9c033870-f167-4235-86ff-98005452a16c,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40295919-4c2c-4e1e-be95-73e18d612ce4", "address": "fa:16:3e:06:1d:a0", "network": {"id": "9feb5d39-ce22-4ffd-b5a0-f44a21399308", "bridge": "br-int", "label": "tempest-device-tagging-net2-639540845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40295919-4c", "ovs_interfaceid": "40295919-4c2c-4e1e-be95-73e18d612ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:44:03.942729 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converting VIF {"id": "40295919-4c2c-4e1e-be95-73e18d612ce4", "address": "fa:16:3e:06:1d:a0", "network": {"id": "9feb5d39-ce22-4ffd-b5a0-f44a21399308", "bridge": "br-int", "label": "tempest-device-tagging-net2-639540845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40295919-4c", "ovs_interfaceid": "40295919-4c2c-4e1e-be95-73e18d612ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:03.943016 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:1d:a0,bridge_name='br-int',has_traffic_filtering=True,id=40295919-4c2c-4e1e-be95-73e18d612ce4,network=Network(9feb5d39-ce22-4ffd-b5a0-f44a21399308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40295919-4c') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:03.943250 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:1d:a0,bridge_name='br-int',has_traffic_filtering=True,id=40295919-4c2c-4e1e-be95-73e18d612ce4,network=Network(9feb5d39-ce22-4ffd-b5a0-f44a21399308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40295919-4c') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:44:03.944707 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.945358 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40295919-4c, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:03.947057 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.947522 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:03.957539 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.960098 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.960098 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3623fc52-2e1a-4951-b6aa-64c8caede733) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:03.961719 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.962213 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:03.970745 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.973095 np0000003587 nova-compute[98952]: INFO os_vif [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:1d:a0,bridge_name='br-int',has_traffic_filtering=True,id=40295919-4c2c-4e1e-be95-73e18d612ce4,network=Network(9feb5d39-ce22-4ffd-b5a0-f44a21399308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40295919-4c') Jun 25 04:44:03.973952 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1434404356',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-1434404356',id=8,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5fI7yNY+vtWfP6sAEqW81Ob/M0+caqTNEaqf66GbJOFzQ10yeZKXCZkAEA1454wRog9bgRijpgzGKf9EXrMHobXUkpq6fgIwY7w+jABzxBMefwpq8P4Wvi0vvmcHxoKQ==',key_name='tempest-keypair-1601168903',keypairs=,launch_index=0,launched_at=2026-06-25T04:42:50Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='1c1a4dead6ad4de1bb75262d9c52bbee',ramdisk_id='',reservation_id='r-gtp0jtk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-479660225',owner_user_name='tempest-TaggedBootDevicesTest_v242-479660225-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be344ec982ae4676b6a89325d3578d73',uuid=9c033870-f167-4235-86ff-98005452a16c,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f002d56c-77f0-4fb0-9501-751106b08f89", "address": "fa:16:3e:fe:a0:95", "network": {"id": "9feb5d39-ce22-4ffd-b5a0-f44a21399308", "bridge": "br-int", "label": "tempest-device-tagging-net2-639540845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf002d56c-77", "ovs_interfaceid": "f002d56c-77f0-4fb0-9501-751106b08f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:44:03.974361 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converting VIF {"id": "f002d56c-77f0-4fb0-9501-751106b08f89", "address": "fa:16:3e:fe:a0:95", "network": {"id": "9feb5d39-ce22-4ffd-b5a0-f44a21399308", "bridge": "br-int", "label": "tempest-device-tagging-net2-639540845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1c1a4dead6ad4de1bb75262d9c52bbee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf002d56c-77", "ovs_interfaceid": "f002d56c-77f0-4fb0-9501-751106b08f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:03.974993 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a0:95,bridge_name='br-int',has_traffic_filtering=True,id=f002d56c-77f0-4fb0-9501-751106b08f89,network=Network(9feb5d39-ce22-4ffd-b5a0-f44a21399308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf002d56c-77') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:03.975284 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a0:95,bridge_name='br-int',has_traffic_filtering=True,id=f002d56c-77f0-4fb0-9501-751106b08f89,network=Network(9feb5d39-ce22-4ffd-b5a0-f44a21399308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf002d56c-77') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:44:03.976887 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.977205 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf002d56c-77, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:03.978750 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.980830 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:03.983217 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.984114 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.984305 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b1aef18-a8b6-4247-8e69-5d544cdb40ed) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:03.985256 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.987665 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:03.987665 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:03.991052 np0000003587 nova-compute[98952]: INFO os_vif [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a0:95,bridge_name='br-int',has_traffic_filtering=True,id=f002d56c-77f0-4fb0-9501-751106b08f89,network=Network(9feb5d39-ce22-4ffd-b5a0-f44a21399308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf002d56c-77') Jun 25 04:44:03.995100 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] calling os-brick to detach iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 25 04:44:03.995100 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1a3ea2da-7efc-4b95-830c-6c043906aa00', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:44:03.995100 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:04.301157 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 25 04:44:04.526375 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-adff3cd6-6aac-47cb-98e4-cf3ef20917d5 req-58279894-a423-49f4-891d-4ae3eb407615 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-e12da27e-2953-4784-80b6-5f7204f4e399 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:04.531027 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-adff3cd6-6aac-47cb-98e4-cf3ef20917d5 req-58279894-a423-49f4-891d-4ae3eb407615 service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:04.532229 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-adff3cd6-6aac-47cb-98e4-cf3ef20917d5 req-58279894-a423-49f4-891d-4ae3eb407615 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:04.532373 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-adff3cd6-6aac-47cb-98e4-cf3ef20917d5 req-58279894-a423-49f4-891d-4ae3eb407615 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:04.532621 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-adff3cd6-6aac-47cb-98e4-cf3ef20917d5 req-58279894-a423-49f4-891d-4ae3eb407615 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] No waiting events found dispatching network-vif-unplugged-e12da27e-2953-4784-80b6-5f7204f4e399 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:04.533694 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-adff3cd6-6aac-47cb-98e4-cf3ef20917d5 req-58279894-a423-49f4-891d-4ae3eb407615 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-e12da27e-2953-4784-80b6-5f7204f4e399 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:04.535065 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-adff3cd6-6aac-47cb-98e4-cf3ef20917d5 req-58279894-a423-49f4-891d-4ae3eb407615 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-f002d56c-77f0-4fb0-9501-751106b08f89 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:04.543285 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-adff3cd6-6aac-47cb-98e4-cf3ef20917d5 req-58279894-a423-49f4-891d-4ae3eb407615 service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:04.544495 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-adff3cd6-6aac-47cb-98e4-cf3ef20917d5 req-58279894-a423-49f4-891d-4ae3eb407615 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:04.544495 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-adff3cd6-6aac-47cb-98e4-cf3ef20917d5 req-58279894-a423-49f4-891d-4ae3eb407615 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:04.544495 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-adff3cd6-6aac-47cb-98e4-cf3ef20917d5 req-58279894-a423-49f4-891d-4ae3eb407615 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] No waiting events found dispatching network-vif-unplugged-f002d56c-77f0-4fb0-9501-751106b08f89 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:04.544495 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-adff3cd6-6aac-47cb-98e4-cf3ef20917d5 req-58279894-a423-49f4-891d-4ae3eb407615 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-f002d56c-77f0-4fb0-9501-751106b08f89 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:04.544495 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-adff3cd6-6aac-47cb-98e4-cf3ef20917d5 req-58279894-a423-49f4-891d-4ae3eb407615 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-f002d56c-77f0-4fb0-9501-751106b08f89 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:04.544495 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-adff3cd6-6aac-47cb-98e4-cf3ef20917d5 req-58279894-a423-49f4-891d-4ae3eb407615 service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:04.544495 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-adff3cd6-6aac-47cb-98e4-cf3ef20917d5 req-58279894-a423-49f4-891d-4ae3eb407615 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:04.544879 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-adff3cd6-6aac-47cb-98e4-cf3ef20917d5 req-58279894-a423-49f4-891d-4ae3eb407615 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:04.544879 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-adff3cd6-6aac-47cb-98e4-cf3ef20917d5 req-58279894-a423-49f4-891d-4ae3eb407615 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] No waiting events found dispatching network-vif-unplugged-f002d56c-77f0-4fb0-9501-751106b08f89 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:04.545504 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-adff3cd6-6aac-47cb-98e4-cf3ef20917d5 req-58279894-a423-49f4-891d-4ae3eb407615 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-f002d56c-77f0-4fb0-9501-751106b08f89 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:04.790446 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.523s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:04.906632 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-ad0b250f-8e83-413c-92d4-1c139ad04422 req-842d72c3-49e8-43c7-8c84-7592507c1ab3 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-aa227a29-8d0b-49f2-a71e-233ba6d38b79 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:04.906632 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ad0b250f-8e83-413c-92d4-1c139ad04422 req-842d72c3-49e8-43c7-8c84-7592507c1ab3 service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:04.906632 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ad0b250f-8e83-413c-92d4-1c139ad04422 req-842d72c3-49e8-43c7-8c84-7592507c1ab3 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:04.906632 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ad0b250f-8e83-413c-92d4-1c139ad04422 req-842d72c3-49e8-43c7-8c84-7592507c1ab3 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:04.906632 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-ad0b250f-8e83-413c-92d4-1c139ad04422 req-842d72c3-49e8-43c7-8c84-7592507c1ab3 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] No waiting events found dispatching network-vif-unplugged-aa227a29-8d0b-49f2-a71e-233ba6d38b79 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:04.906632 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-ad0b250f-8e83-413c-92d4-1c139ad04422 req-842d72c3-49e8-43c7-8c84-7592507c1ab3 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-aa227a29-8d0b-49f2-a71e-233ba6d38b79 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:04.948090 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:05.325183 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Found WWN 330000000a5c943c3 for multipath device dm-18 {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 25 04:44:05.325686 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.083s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:05.329051 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.329s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:05.329432 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] <== connect_volume: return (4087ms) {'type': 'block', 'scsi_wwn': '330000000a5c943c3', 'path': '/dev/dm-18', 'multipath_id': '330000000a5c943c3'} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:44:05.329642 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a5c943c3', 'path': '/dev/dm-18', 'multipath_id': '330000000a5c943c3'} {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 25 04:44:05.329829 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31e8293d-50f2-4271-8cc5-bdd52f895f6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 25 04:44:05.330879 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', 0)] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 25 04:44:05.334590 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lazy-loading 'flavor' on Instance uuid ea0f9737-865a-4199-9077-b64e88af15db {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:44:05.389210 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:44:05.389210 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:44:05.389210 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:05.389210 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:05.389210 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:05.389210 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:05.389210 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:05.389210 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:05.389210 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:05.389210 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:05.389210 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:05.389210 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:05.389210 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:44:05.389210 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:44:05.389210 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:05.389210 np0000003587 nova-compute[98952]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:05.389210 np0000003587 nova-compute[98952]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:05.389210 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:05.389210 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:05.389210 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:05.389210 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:05.389210 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:05.389210 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:05.390408 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:44:05.390408 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:44:05.390408 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:05.390408 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:05.390408 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:05.390408 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:05.390408 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:05.390408 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:05.390408 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:05.390408 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:05.390408 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:05.390408 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:05.390408 np0000003587 nova-compute[98952]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:44:05.390408 np0000003587 nova-compute[98952]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d (non-flash) Jun 25 04:44:05.390408 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:05.390408 np0000003587 nova-compute[98952]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:05.390408 np0000003587 nova-compute[98952]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:05.390408 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:05.390408 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:05.390408 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:05.390408 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:05.390408 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:05.390408 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:05.390408 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', '15'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', '6')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 25 04:44:05.391506 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', '26')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:44:05.398588 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d', '25')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:44:05.399574 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Resulting device map defaultdict(. at 0x7a16b8133a60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d'): ({'sds'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d'): ({'sdr'}, set())}) {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 25 04:44:05.400659 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Removing multipathed devices sdr, sds {{(pid=98952) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 25 04:44:05.401079 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Flush multipath device 330000000908985c8 {{(pid=98952) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 25 04:44:05.481215 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Remove SCSI device /dev/sdr with /sys/block/sdr/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:44:05.538364 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Remove SCSI device /dev/sds with /sys/block/sds/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:44:05.597904 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Checking to see if SCSI volumes sdr, sds have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 25 04:44:05.598102 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] SCSI volumes sdr, sds have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 25 04:44:05.602261 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Checking to see if device paths {'sdr', 'sds'} are still under multipathd monitoring {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 25 04:44:05.620099 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Device paths {'sdr', 'sds'} have been removed from multipathd monitoring. {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 25 04:44:05.620392 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d')] {{(pid=98952) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 25 04:44:05.641848 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:05.681752 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-4d1f24c3-d7a8-450a-92d5-0e807355b791 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:05.681947 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:05.682180 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:05.682357 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:05.683300 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] No waiting events found dispatching network-vif-unplugged-4d1f24c3-d7a8-450a-92d5-0e807355b791 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:05.683354 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-4d1f24c3-d7a8-450a-92d5-0e807355b791 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:05.683701 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-7e8846aa-559c-48a1-bf9a-ab431fd380ed {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:05.683701 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:05.684631 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:05.684631 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:05.687585 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] No waiting events found dispatching network-vif-unplugged-7e8846aa-559c-48a1-bf9a-ab431fd380ed {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:05.687585 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-7e8846aa-559c-48a1-bf9a-ab431fd380ed for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:05.687585 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-7e8846aa-559c-48a1-bf9a-ab431fd380ed {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:05.687585 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:05.687585 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:05.687585 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:05.687585 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] No waiting events found dispatching network-vif-unplugged-7e8846aa-559c-48a1-bf9a-ab431fd380ed {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:05.687585 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-7e8846aa-559c-48a1-bf9a-ab431fd380ed for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:05.687585 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-789bf2ca-f86e-403a-88a3-0103291a84df {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:05.687585 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:05.687585 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:05.687585 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:05.687585 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] No waiting events found dispatching network-vif-unplugged-789bf2ca-f86e-403a-88a3-0103291a84df {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:05.687585 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-789bf2ca-f86e-403a-88a3-0103291a84df for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:05.687585 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-789bf2ca-f86e-403a-88a3-0103291a84df {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:05.687585 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:05.687585 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:05.687585 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:05.689000 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] No waiting events found dispatching network-vif-unplugged-789bf2ca-f86e-403a-88a3-0103291a84df {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:05.691599 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-789bf2ca-f86e-403a-88a3-0103291a84df for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:05.691947 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-40295919-4c2c-4e1e-be95-73e18d612ce4 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:05.692719 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:05.693380 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:05.693425 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:05.694730 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] No waiting events found dispatching network-vif-unplugged-40295919-4c2c-4e1e-be95-73e18d612ce4 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:05.694730 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d2e7b6f3-c671-41d1-b6b0-ed04504f9957 req-44b2feff-6afd-455c-aace-31eba44d5f11 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-40295919-4c2c-4e1e-be95-73e18d612ce4 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:05.699824 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d, portal: 192.168.40.100,3260] Jun 25 04:44:05.699824 np0000003587 nova-compute[98952]: Logout of [sid: 26, target: iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d, portal: 192.168.40.100,3260] successful. Jun 25 04:44:05.699824 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:05.738365 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:05.758380 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:05.836045 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d, portal: 192.168.50.100,3260] Jun 25 04:44:05.836045 np0000003587 nova-compute[98952]: Logout of [sid: 25, target: iqn.2023-03.storpool.com:os--volume-31e8293d-50f2-4271-8cc5-bdd52f895f6d, portal: 192.168.50.100,3260] successful. Jun 25 04:44:05.836045 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:05.840746 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Attempting to attach volume 89748225-9d41-4fb1-b47a-f0f88aa6ebfa with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98952) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 25 04:44:05.842976 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] attach device xml: Jun 25 04:44:05.842976 np0000003587 nova-compute[98952]: Jun 25 04:44:05.842976 np0000003587 nova-compute[98952]: Jun 25 04:44:05.842976 np0000003587 nova-compute[98952]: Jun 25 04:44:05.842976 np0000003587 nova-compute[98952]: Jun 25 04:44:05.842976 np0000003587 nova-compute[98952]: 89748225-9d41-4fb1-b47a-f0f88aa6ebfa Jun 25 04:44:05.842976 np0000003587 nova-compute[98952]: Jun 25 04:44:05.842976 np0000003587 nova-compute[98952]: Jun 25 04:44:05.842976 np0000003587 nova-compute[98952]: {{(pid=98952) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 25 04:44:05.879272 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:05.879458 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.554s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:05.879600 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] <== disconnect_volume: return (3882ms) None {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:44:05.879825 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Disconnected iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 25 04:44:05.880362 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Deleting instance files /opt/stack/data/nova/instances/df96228c-c3b2-457d-9eb1-2e82186076f4_del Jun 25 04:44:05.881139 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.885s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:05.881877 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1a3ea2da-7efc-4b95-830c-6c043906aa00', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 25 04:44:05.882046 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', 0)] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 25 04:44:05.882995 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Deletion of /opt/stack/data/nova/instances/df96228c-c3b2-457d-9eb1-2e82186076f4_del complete Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:05.938321 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:05.940252 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', '15'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', '6')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 25 04:44:05.940252 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', '11')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:44:05.941162 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00', '12')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:44:05.943028 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Resulting device map defaultdict(. at 0x7a16b81fee80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00'): ({'sdj'}, set())}) {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 25 04:44:05.943441 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Removing multipathed devices sdj, sdk {{(pid=98952) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 25 04:44:05.943865 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Flush multipath device 330000000561a10be {{(pid=98952) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 25 04:44:06.003110 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquiring lock "8b915629-823e-4b55-bc64-d73e58b79bdc" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:06.004236 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.003s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:06.004454 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Attaching volume 25f2f478-abf9-45a5-8377-8af2524b83dd to /dev/vdb Jun 25 04:44:06.012705 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:44:06.089524 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:44:06.094354 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.80', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003587', 'execute': None}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:44:06.117843 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.scaleio [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98952) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 25 04:44:06.146225 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 25 04:44:06.146225 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 25 04:44:06.147161 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 25 04:44:06.148706 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Running cmd (subprocess): nvme version {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:06.171007 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 25 04:44:06.171887 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00')] {{(pid=98952) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 25 04:44:06.192657 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] 'nvme version' failed. Not Retrying. {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 04:44:06.196081 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] nvme not present on system {{(pid=98952) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 25 04:44:06.212576 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98952) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 25 04:44:06.216331 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.lightos [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Current host hostNQN and IP(s) are ['10.4.3.80', 'fe80::f816:3eff:feea:dfe4', '192.168.40.6', 'fe80::f816:3eff:fe4f:7c42', '192.168.50.6', 'fe80::f816:3eff:fe6c:e6a6', '192.168.10.6', 'fe80::f816:3eff:fe17:d749', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::b035:28ff:fe70:6f4a', 'fe80::fc16:3eff:fe8c:f883', 'fe80::483f:f2ff:fe48:75ca', 'fe80::fc16:3eff:fe78:7ac8', 'fe80::1038:1dff:fe1c:d44b', 'fe80::fc16:3eff:fe3a:4858', 'fe80::fc16:3eff:fe4f:4083', 'fe80::fc16:3eff:fee6:e022', 'fe80::fc16:3eff:feee:97a2', 'fe80::fc16:3eff:fe57:c07f', 'fe80::fc16:3eff:fecc:30bf', 'fe80::fc16:3eff:feaa:4f74', 'fe80::d0a9:65ff:fe25:9a79', 'fe80::fc16:3eff:fe42:3aef', 'fe80::fc16:3eff:fee8:baea', 'fe80::fc16:3eff:fea7:57df', 'fe80::fc16:3eff:fefa:997d', 'fe80::f404:33ff:febc:fb62', 'fe80::fc16:3eff:fe95:908b', 'fe80::ac3e:37ff:fede:535d', 'fe80::fc16:3eff:fecd:9b6f', 'fe80::7cf5:c7ff:fe12:d4dc', 'fe80::fc16:3eff:fe55:5b09', 'fe80::fc16:3eff:fe48:68a7', 'fe80::fc16:3eff:fe01:4b19', 'fe80::c096:18ff:fe44:3261'] Jun 25 04:44:06.216547 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 25 04:44:06.216840 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] LIGHTOS: no hostnqn found. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 25 04:44:06.218701 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.80', 'host': 'np0000003587', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c81886224652', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a1feb13-40e2-4ac6-989e-b08a6fc0f283', 'nvme_native_multipath': False} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:44:06.218701 np0000003587 nova-compute[98952]: DEBUG nova.virt.block_device [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Updating existing volume attachment record: 82d1c32a-0140-4f4b-9476-e5ff70c7c47f {{(pid=98952) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 25 04:44:06.224938 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:06.286945 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00, portal: 192.168.40.100,3260] Jun 25 04:44:06.286945 np0000003587 nova-compute[98952]: Logout of [sid: 11, target: iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00, portal: 192.168.40.100,3260] successful. Jun 25 04:44:06.286945 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:06.331689 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:06.364614 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:06.415651 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Took 5.39 seconds to destroy the instance on the hypervisor. Jun 25 04:44:06.418118 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._common.loopingcall [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98952) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 25 04:44:06.418690 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [-] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Deallocating network for instance {{(pid=98952) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 25 04:44:06.418690 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] deallocate_for_instance() {{(pid=98952) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 25 04:44:06.419067 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:06.440958 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00, portal: 192.168.50.100,3260] Jun 25 04:44:06.440958 np0000003587 nova-compute[98952]: Logout of [sid: 12, target: iqn.2023-03.storpool.com:os--volume-1a3ea2da-7efc-4b95-830c-6c043906aa00, portal: 192.168.50.100,3260] successful. Jun 25 04:44:06.440958 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:06.478864 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:06.479577 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.599s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:06.479577 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] <== disconnect_volume: return (2484ms) None {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:44:06.479928 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Disconnected iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 25 04:44:06.483532 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] calling os-brick to detach iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 25 04:44:06.483993 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:44:06.483993 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:06.485217 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:06.488001 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 25 04:44:06.488863 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', 0)] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 25 04:44:06.523393 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:06.553524 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:06.553524 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:06.553524 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:06.553524 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:06.553524 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:06.553524 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:06.553524 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:06.553524 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:06.553524 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:06.553524 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:06.553524 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:06.553524 np0000003587 nova-compute[98952]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:06.553524 np0000003587 nova-compute[98952]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:06.553524 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:06.553524 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:06.553524 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:06.553524 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:06.553524 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:06.553524 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:06.554414 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsi session list stdout=tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:06.554414 np0000003587 nova-compute[98952]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf (non-flash) Jun 25 04:44:06.554414 np0000003587 nova-compute[98952]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:06.554414 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:06.554414 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:06.554414 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:06.554414 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:06.554414 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:06.554414 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:06.554414 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:06.554414 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:06.554414 np0000003587 nova-compute[98952]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:06.554414 np0000003587 nova-compute[98952]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:06.554414 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:06.554414 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:06.554414 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:06.554414 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:06.554414 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:06.554414 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:06.555443 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', '15'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', '6')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 25 04:44:06.555580 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', '16')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:44:06.559679 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf', '15')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:44:06.561541 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Resulting device map defaultdict(. at 0x7a16b0131800>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf'): ({'sdf'}, set())}) {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 25 04:44:06.561541 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Removing multipathed devices sdf, sdg {{(pid=98952) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 25 04:44:06.561541 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Flush multipath device 330000000cc189752 {{(pid=98952) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 25 04:44:06.600444 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:44:06.655451 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:44:06.729753 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 25 04:44:06.729955 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 25 04:44:06.733083 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 25 04:44:06.763993 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 25 04:44:06.765964 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf')] {{(pid=98952) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 25 04:44:06.787384 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:06.846962 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf, portal: 192.168.40.100,3260] Jun 25 04:44:06.846962 np0000003587 nova-compute[98952]: Logout of [sid: 16, target: iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf, portal: 192.168.40.100,3260] successful. Jun 25 04:44:06.846962 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:06.847918 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Calling os-brick to attach iSCSI Volume {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 25 04:44:06.849883 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25f2f478-abf9-45a5-8377-8af2524b83dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:44:06.852636 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:06.883225 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:06.902747 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:06.969207 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf, portal: 192.168.50.100,3260] Jun 25 04:44:06.969207 np0000003587 nova-compute[98952]: Logout of [sid: 15, target: iqn.2023-03.storpool.com:os--volume-e0002b7f-67b9-4af1-82f9-7e5e8a55faaf, portal: 192.168.50.100,3260] successful. Jun 25 04:44:06.969207 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:06.997909 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:06.998345 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.514s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:06.998825 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] <== disconnect_volume: return (515ms) None {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:44:07.000120 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Disconnected iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 25 04:44:07.000667 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.149s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:07.001226 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25f2f478-abf9-45a5-8377-8af2524b83dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 25 04:44:07.004982 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] calling os-brick to detach iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 25 04:44:07.004982 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cc7be47d-8d0a-4286-86d2-621b59df6075', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:44:07.006742 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:07.017785 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:07.018542 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:07.019340 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:07.019715 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:44:07.021535 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:07.021683 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:44:07.037115 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:44:07.037115 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:07.049419 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:44:07.049419 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:07.057243 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd] added Jun 25 04:44:07.057243 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:44:07.057243 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:44:07.057243 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:44:07.057243 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:44:07.057243 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:44:07.057243 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:07.058237 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:44:07.058237 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.038(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:44:07.058237 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:44:07.067961 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd] added Jun 25 04:44:07.067961 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:44:07.067961 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:44:07.067961 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:44:07.067961 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:44:07.067961 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:44:07.067961 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:07.068150 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:44:07.068411 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0467(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:44:07.068624 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:44:07.079099 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2192c340-a3de-4a55-b61d-c5569ec1d32c req-fd6501fe-85a8-4677-999f-d804d4dde3a4 service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Received event network-vif-deleted-2a5c445e-b115-42f3-984d-bfe5af6670e4 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:07.079099 np0000003587 nova-compute[98952]: INFO nova.compute.manager [req-2192c340-a3de-4a55-b61d-c5569ec1d32c req-fd6501fe-85a8-4677-999f-d804d4dde3a4 service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Neutron deleted interface 2a5c445e-b115-42f3-984d-bfe5af6670e4; detaching it from the instance and deleting it from the info cache Jun 25 04:44:07.083319 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2192c340-a3de-4a55-b61d-c5569ec1d32c req-fd6501fe-85a8-4677-999f-d804d4dde3a4 service nova] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Detach interface failed, port_id=2a5c445e-b115-42f3-984d-bfe5af6670e4, reason: Instance df96228c-c3b2-457d-9eb1-2e82186076f4 could not be found. {{(pid=98952) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 25 04:44:07.488121 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:44:07.645937 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:07.645937 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:07.646641 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:07.646641 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No VIF found with MAC fa:16:3e:57:c0:7f, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:44:07.684195 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:07.798723 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-a871fe36-52ed-4adb-9d94-fe800fa1e69d req-aa6b9a9a-6100-4c9e-8802-143e64283205 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-40295919-4c2c-4e1e-be95-73e18d612ce4 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:07.801093 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a871fe36-52ed-4adb-9d94-fe800fa1e69d req-aa6b9a9a-6100-4c9e-8802-143e64283205 service nova] Acquiring lock "9c033870-f167-4235-86ff-98005452a16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:07.802590 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a871fe36-52ed-4adb-9d94-fe800fa1e69d req-aa6b9a9a-6100-4c9e-8802-143e64283205 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:07.802590 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a871fe36-52ed-4adb-9d94-fe800fa1e69d req-aa6b9a9a-6100-4c9e-8802-143e64283205 service nova] Lock "9c033870-f167-4235-86ff-98005452a16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:07.802590 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-a871fe36-52ed-4adb-9d94-fe800fa1e69d req-aa6b9a9a-6100-4c9e-8802-143e64283205 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] No waiting events found dispatching network-vif-unplugged-40295919-4c2c-4e1e-be95-73e18d612ce4 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:07.802590 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-a871fe36-52ed-4adb-9d94-fe800fa1e69d req-aa6b9a9a-6100-4c9e-8802-143e64283205 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-unplugged-40295919-4c2c-4e1e-be95-73e18d612ce4 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:07.989705 np0000003587 nova-compute[98952]: INFO nova.compute.manager [-] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Took 1.57 seconds to deallocate network for instance. Jun 25 04:44:08.061602 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:44:08.069716 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.40.100 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:44:08.091607 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.50.100 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:44:08.111248 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:08.118221 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:08.131648 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:08.149613 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:08.162793 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:08.162793 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:08.162793 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:08.162793 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:08.162793 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:08.162793 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:08.162793 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:08.162793 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:08.162793 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:08.162793 np0000003587 nova-compute[98952]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:08.162793 np0000003587 nova-compute[98952]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:08.162793 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:08.162793 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:08.162793 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:08.162793 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:08.162793 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:08.162793 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:08.163345 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:08.163345 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:08.163345 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:08.163345 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:08.163345 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:08.163345 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:08.163345 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:08.163345 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:08.163345 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:08.163345 np0000003587 nova-compute[98952]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:08.163345 np0000003587 nova-compute[98952]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:08.163345 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:08.163345 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:08.163345 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:08.163345 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:08.163345 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:08.163345 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:08.253715 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd, portal: 192.168.40.100,3260] Jun 25 04:44:08.253715 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd, portal: 192.168.40.100,3260] successful. Jun 25 04:44:08.253715 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:08.272068 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:08.300754 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:08.300754 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:08.300754 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:08.300754 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:08.300754 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:08.300754 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:08.300754 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:08.300754 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:08.300754 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:08.300754 np0000003587 nova-compute[98952]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:08.300754 np0000003587 nova-compute[98952]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:08.300754 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:08.300754 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:08.300754 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:08.300754 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,0 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:08.300754 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:08.300754 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:08.300754 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:08.300754 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:08.301284 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:08.301284 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:08.301284 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:08.301284 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:08.301284 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:08.301284 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:08.301284 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:08.301284 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:08.301284 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:08.301284 np0000003587 nova-compute[98952]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:08.301284 np0000003587 nova-compute[98952]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:08.301284 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:08.301284 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:08.301284 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:08.301284 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,0 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:08.301284 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:08.301284 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:08.301284 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:08.301284 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:08.301284 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.282s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:08.301846 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Connected to 192.168.40.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:44:08.304568 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] HCTL ('11', '-', '-', 0) found on session 35 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:44:08.304568 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:44:08.327773 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Searching for a device in session 35 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:44:08.327773 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25f2f478-abf9-45a5-8377-8af2524b83dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:44:08.617958 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Took 0.63 seconds to detach 1 volumes for instance. Jun 25 04:44:08.620905 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Deleting volume: 31e8293d-50f2-4271-8cc5-bdd52f895f6d {{(pid=98952) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}} Jun 25 04:44:08.987098 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:09.053977 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "520409fb-f97c-4503-b97b-7cecd377102a" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:09.053977 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "520409fb-f97c-4503-b97b-7cecd377102a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:09.208674 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:09.208957 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:09.252528 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd, portal: 192.168.50.100,3260] Jun 25 04:44:09.252528 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd, portal: 192.168.50.100,3260] successful. Jun 25 04:44:09.252528 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:09.253606 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-8f303176-3ef2-4f6d-b22f-e1806f0bb84d tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "ea0f9737-865a-4199-9077-b64e88af15db" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 8.843s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:09.272365 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:09.301842 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:09.301842 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:09.301842 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:09.301842 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:09.301842 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:09.301842 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:09.301842 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:09.301842 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:09.301842 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:09.301842 np0000003587 nova-compute[98952]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:09.301842 np0000003587 nova-compute[98952]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:09.301842 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:09.301842 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:09.301842 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:09.301842 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:09.301842 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:09.301842 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:09.301842 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:09.301842 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:09.302569 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:09.302569 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:09.302569 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:09.302569 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:09.302569 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:09.302569 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:09.302569 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:09.302569 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:09.302569 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:09.302569 np0000003587 nova-compute[98952]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:09.302569 np0000003587 nova-compute[98952]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:09.302569 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:09.302569 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:09.302569 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:09.302569 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:09.302569 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:09.302569 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:09.302569 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:09.302569 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:09.302569 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.281s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:09.303471 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Connected to 192.168.50.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:44:09.304797 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] HCTL ('12', '-', '-', 0) found on session 36 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:44:09.304966 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:44:09.332389 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Searching for a device in session 36 and hctl ['12', '*', '*', 0] yield: None {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:44:09.557332 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lazy-loading 'flavor' on Instance uuid 520409fb-f97c-4503-b97b-7cecd377102a {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:44:09.950249 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:10.269945 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:44:10.270186 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:44:10.333847 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Searching for a device in session 36 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:44:10.333847 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '25f2f478-abf9-45a5-8377-8af2524b83dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:44:10.361001 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Found WWN 33000000019fbaf06 for multipath device dm-4 {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 25 04:44:10.361001 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.358s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:10.361001 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] <== connect_volume: return (3507ms) {'type': 'block', 'scsi_wwn': '33000000019fbaf06', 'path': '/dev/dm-4', 'multipath_id': '33000000019fbaf06'} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:44:10.361001 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000019fbaf06', 'path': '/dev/dm-4', 'multipath_id': '33000000019fbaf06'} {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 25 04:44:10.361001 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.353s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:10.361001 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cc7be47d-8d0a-4286-86d2-621b59df6075', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 25 04:44:10.361001 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', 0)] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 25 04:44:10.364440 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lazy-loading 'flavor' on Instance uuid 8b915629-823e-4b55-bc64-d73e58b79bdc {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:44:10.412939 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:10.412939 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:10.412939 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:10.412939 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:10.412939 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:10.412939 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:10.412939 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:10.412939 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:10.412939 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:10.412939 np0000003587 nova-compute[98952]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:10.412939 np0000003587 nova-compute[98952]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:10.412939 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:10.412939 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:10.412939 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:10.412939 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:10.412939 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:10.412939 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:10.412939 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:10.412939 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:10.416763 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:10.416763 np0000003587 nova-compute[98952]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075 (non-flash) Jun 25 04:44:10.416763 np0000003587 nova-compute[98952]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:10.416763 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:10.416763 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:10.416763 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:10.416763 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:10.416763 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:10.416763 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:10.416763 np0000003587 nova-compute[98952]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:10.416763 np0000003587 nova-compute[98952]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36 (non-flash) Jun 25 04:44:10.416763 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:10.416763 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:10.416763 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:10.416763 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:10.416763 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:10.416763 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:10.416763 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:10.416763 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:10.416763 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-da8df7d9-8a8a-485d-a989-38df29e0ea36', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', '6')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 25 04:44:10.416763 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', '17')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:44:10.416763 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075', '18')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:44:10.416763 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Resulting device map defaultdict(. at 0x7a16b81fcd60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075'): ({'sdi'}, set())}) {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 25 04:44:10.416763 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Removing multipathed devices sdh, sdi {{(pid=98952) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 25 04:44:10.417647 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Flush multipath device 330000000780d26f6 {{(pid=98952) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 25 04:44:10.452842 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:44:10.524228 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:44:10.566977 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 25 04:44:10.567218 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 25 04:44:10.569593 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 25 04:44:10.570738 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "520409fb-f97c-4503-b97b-7cecd377102a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.518s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:10.584979 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 25 04:44:10.585257 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075')] {{(pid=98952) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 25 04:44:10.601285 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:10.648474 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075, portal: 192.168.40.100,3260] Jun 25 04:44:10.648474 np0000003587 nova-compute[98952]: Logout of [sid: 17, target: iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075, portal: 192.168.40.100,3260] successful. Jun 25 04:44:10.648474 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:10.680916 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:10.694431 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:10.739816 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075, portal: 192.168.50.100,3260] Jun 25 04:44:10.739816 np0000003587 nova-compute[98952]: Logout of [sid: 18, target: iqn.2023-03.storpool.com:os--volume-cc7be47d-8d0a-4286-86d2-621b59df6075, portal: 192.168.50.100,3260] successful. Jun 25 04:44:10.739816 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:10.771519 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:10.772065 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:10.772274 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] <== disconnect_volume: return (3766ms) None {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:44:10.772466 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Disconnected iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 25 04:44:10.772839 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Deleting instance files /opt/stack/data/nova/instances/9c033870-f167-4235-86ff-98005452a16c_del Jun 25 04:44:10.773481 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Deletion of /opt/stack/data/nova/instances/9c033870-f167-4235-86ff-98005452a16c_del complete Jun 25 04:44:10.776175 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:44:10.867920 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Attempting to attach volume 25f2f478-abf9-45a5-8377-8af2524b83dd with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98952) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 25 04:44:10.869729 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] attach device xml: Jun 25 04:44:10.869729 np0000003587 nova-compute[98952]: Jun 25 04:44:10.869729 np0000003587 nova-compute[98952]: Jun 25 04:44:10.869729 np0000003587 nova-compute[98952]: Jun 25 04:44:10.869729 np0000003587 nova-compute[98952]: Jun 25 04:44:10.869729 np0000003587 nova-compute[98952]: 25f2f478-abf9-45a5-8377-8af2524b83dd Jun 25 04:44:10.869729 np0000003587 nova-compute[98952]: Jun 25 04:44:10.869729 np0000003587 nova-compute[98952]: {{(pid=98952) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 25 04:44:11.284953 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.076s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:11.294435 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Took 9.22 seconds to destroy the instance on the hypervisor. Jun 25 04:44:11.295295 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._common.loopingcall [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98952) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 25 04:44:11.296045 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [-] [instance: 9c033870-f167-4235-86ff-98005452a16c] Deallocating network for instance {{(pid=98952) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 25 04:44:11.296045 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: 9c033870-f167-4235-86ff-98005452a16c] deallocate_for_instance() {{(pid=98952) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 25 04:44:11.296250 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:11.365088 np0000003587 nova-compute[98952]: INFO nova.scheduler.client.report [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Deleted allocations for instance df96228c-c3b2-457d-9eb1-2e82186076f4 Jun 25 04:44:11.491002 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:11.569780 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:11.678080 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "520409fb-f97c-4503-b97b-7cecd377102a" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:11.678080 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "520409fb-f97c-4503-b97b-7cecd377102a" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:11.678080 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Attaching volume 89748225-9d41-4fb1-b47a-f0f88aa6ebfa to /dev/vdb Jun 25 04:44:11.753362 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.80', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003587', 'execute': None}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:44:11.769073 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.scaleio [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98952) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 25 04:44:11.805666 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): nvme version {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:11.842711 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] 'nvme version' failed. Not Retrying. {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 04:44:11.843923 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.nvmeof [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] nvme not present on system {{(pid=98952) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 25 04:44:11.853348 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98952) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 25 04:44:11.860089 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.lightos [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Current host hostNQN and IP(s) are ['10.4.3.80', 'fe80::f816:3eff:feea:dfe4', '192.168.40.6', 'fe80::f816:3eff:fe4f:7c42', '192.168.50.6', 'fe80::f816:3eff:fe6c:e6a6', '192.168.10.6', 'fe80::f816:3eff:fe17:d749', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::b035:28ff:fe70:6f4a', 'fe80::fc16:3eff:fe8c:f883', 'fe80::483f:f2ff:fe48:75ca', 'fe80::fc16:3eff:fe78:7ac8', 'fe80::1038:1dff:fe1c:d44b', 'fe80::fc16:3eff:fe3a:4858', 'fe80::fc16:3eff:fe4f:4083', 'fe80::fc16:3eff:fee6:e022', 'fe80::fc16:3eff:feee:97a2', 'fe80::fc16:3eff:fe57:c07f', 'fe80::fc16:3eff:fecc:30bf', 'fe80::fc16:3eff:feaa:4f74', 'fe80::d0a9:65ff:fe25:9a79', 'fe80::fc16:3eff:fe42:3aef', 'fe80::fc16:3eff:fee8:baea', 'fe80::fc16:3eff:fea7:57df', 'fe80::fc16:3eff:fefa:997d', 'fe80::f404:33ff:febc:fb62', 'fe80::fc16:3eff:fe95:908b', 'fe80::ac3e:37ff:fede:535d', 'fe80::fc16:3eff:fecd:9b6f', 'fe80::7cf5:c7ff:fe12:d4dc', 'fe80::fc16:3eff:fe55:5b09', 'fe80::fc16:3eff:fe48:68a7', 'fe80::fc16:3eff:fe01:4b19', 'fe80::c096:18ff:fe44:3261'] Jun 25 04:44:11.860089 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 25 04:44:11.860089 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] LIGHTOS: no hostnqn found. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 25 04:44:11.860089 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.80', 'host': 'np0000003587', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c81886224652', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a1feb13-40e2-4ac6-989e-b08a6fc0f283', 'nvme_native_multipath': False} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:44:11.860089 np0000003587 nova-compute[98952]: DEBUG nova.virt.block_device [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Updating existing volume attachment record: 04a6acdf-e7bb-4959-988d-3ff46a956f7b {{(pid=98952) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 25 04:44:12.380547 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b9cace0d-3745-44b7-957e-f361e9ddb4af tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "df96228c-c3b2-457d-9eb1-2e82186076f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 11.864s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:12.456515 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Calling os-brick to attach iSCSI Volume {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 25 04:44:12.457047 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:44:12.457270 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:12.458144 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:12.460060 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 25 04:44:12.476705 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:12.477759 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:12.478303 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:44:12.478676 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:12.479432 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:12.479653 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.startup = automatic Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.scan = manual Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.40.100 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:44:12.497277 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.startup = automatic Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.scan = manual Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.50.100 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:44:12.508129 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:12.518493 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:12.531720 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:12.550261 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:12.550261 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:12.550261 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:12.550261 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:12.550261 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:12.550261 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:12.550261 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:12.550261 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:12.550261 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:12.550261 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:12.550261 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:12.550261 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:12.550261 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:12.550261 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:12.550261 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:12.550788 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsi session list stdout=tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:12.550788 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:12.550788 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:12.550788 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:12.550788 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:12.550788 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:12.550788 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:12.550788 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:12.550788 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:12.550788 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:12.550788 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:12.550788 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:12.550788 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:12.550788 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:12.550788 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:12.550788 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.073s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:12.551404 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to 192.168.40.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:44:12.552183 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] HCTL ('28', '0', '0', 0) found on session 34 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:44:12.552474 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Scanning host 28 c: 0, t: 0, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:44:12.567546 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:12.567546 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:12.567546 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:12.567546 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:12.567546 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:12.567546 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:12.567546 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:12.567546 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:12.567546 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:12.567546 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:12.567546 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:12.567546 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:12.567546 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:12.567546 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:12.567546 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:12.568048 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsi session list stdout=tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:12.568048 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:12.568048 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:12.568048 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:12.568048 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:12.568048 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:12.568048 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:12.568048 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:12.568048 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:12.568048 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:12.568048 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:12.568048 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:12.568048 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:12.568048 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:12.568048 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:12.568615 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.089s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:12.568615 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to 192.168.50.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:44:12.569536 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] HCTL ('27', '0', '0', 0) found on session 33 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:44:12.569536 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Scanning host 27 c: 0, t: 0, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:44:12.572135 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching for a device in session 34 and hctl ('28', '0', '0', 0) yield: sdw {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:44:12.572135 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to sdw using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:44:12.578408 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:12.578725 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:12.578873 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:12.579027 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] No VIF found with MAC fa:16:3e:01:4b:19, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:44:12.584593 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching for a device in session 33 and hctl ('27', '0', '0', 0) yield: sdv {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:44:12.584689 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to sdv using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:44:13.432111 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2ad87516-bf57-4e3f-82aa-419cb99c48a9 req-80614e56-cc6e-4216-a3c6-7e0c41bdd858 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-deleted-40295919-4c2c-4e1e-be95-73e18d612ce4 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:13.432826 np0000003587 nova-compute[98952]: INFO nova.compute.manager [req-2ad87516-bf57-4e3f-82aa-419cb99c48a9 req-80614e56-cc6e-4216-a3c6-7e0c41bdd858 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Neutron deleted interface 40295919-4c2c-4e1e-be95-73e18d612ce4; detaching it from the instance and deleting it from the info cache Jun 25 04:44:13.434164 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2ad87516-bf57-4e3f-82aa-419cb99c48a9 req-80614e56-cc6e-4216-a3c6-7e0c41bdd858 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Detach interface failed, port_id=40295919-4c2c-4e1e-be95-73e18d612ce4, reason: Instance 9c033870-f167-4235-86ff-98005452a16c could not be found. {{(pid=98952) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 25 04:44:13.482680 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 25 04:44:13.524032 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ba6b4e8c-b4fa-4a6e-bb87-c8fdf86db57d tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "1b412363-2fb7-4469-b748-80cc52825bb5" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:13.524226 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ba6b4e8c-b4fa-4a6e-bb87-c8fdf86db57d tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "1b412363-2fb7-4469-b748-80cc52825bb5" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:13.524468 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ba6b4e8c-b4fa-4a6e-bb87-c8fdf86db57d tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "1b412363-2fb7-4469-b748-80cc52825bb5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:13.524654 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ba6b4e8c-b4fa-4a6e-bb87-c8fdf86db57d tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "1b412363-2fb7-4469-b748-80cc52825bb5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:13.524782 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ba6b4e8c-b4fa-4a6e-bb87-c8fdf86db57d tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "1b412363-2fb7-4469-b748-80cc52825bb5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:13.527798 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-ba6b4e8c-b4fa-4a6e-bb87-c8fdf86db57d tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Terminating instance Jun 25 04:44:13.885286 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-c13550d0-87a5-49c8-9519-d1df114f3b9b req-cb45281f-4e93-4d7c-a0a8-4583879b77c8 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-deleted-aa227a29-8d0b-49f2-a71e-233ba6d38b79 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:13.885286 np0000003587 nova-compute[98952]: INFO nova.compute.manager [req-c13550d0-87a5-49c8-9519-d1df114f3b9b req-cb45281f-4e93-4d7c-a0a8-4583879b77c8 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Neutron deleted interface aa227a29-8d0b-49f2-a71e-233ba6d38b79; detaching it from the instance and deleting it from the info cache Jun 25 04:44:13.887766 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-c13550d0-87a5-49c8-9519-d1df114f3b9b req-cb45281f-4e93-4d7c-a0a8-4583879b77c8 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Detach interface failed, port_id=aa227a29-8d0b-49f2-a71e-233ba6d38b79, reason: Instance 9c033870-f167-4235-86ff-98005452a16c could not be found. {{(pid=98952) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 25 04:44:13.989897 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:14.032542 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-ba6b4e8c-b4fa-4a6e-bb87-c8fdf86db57d tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Start destroying the instance on the hypervisor. {{(pid=98952) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 25 04:44:14.066283 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:14.072640 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:14.103883 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:14.174884 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e00be8c8-a883-4f7d-bcfc-3d39f7b79230 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 8.171s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:14.302068 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:14.310517 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:14.320636 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-202cb1f7-1eaf-4a26-956a-33ad6ac537c3 req-616fcfb3-c7b5-4eb0-8b36-877290d18502 service nova] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Received event network-vif-unplugged-53b9a3dd-c125-4e7b-b3ee-9debd47394dd {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:14.321527 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-202cb1f7-1eaf-4a26-956a-33ad6ac537c3 req-616fcfb3-c7b5-4eb0-8b36-877290d18502 service nova] Acquiring lock "1b412363-2fb7-4469-b748-80cc52825bb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:14.322177 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-202cb1f7-1eaf-4a26-956a-33ad6ac537c3 req-616fcfb3-c7b5-4eb0-8b36-877290d18502 service nova] Lock "1b412363-2fb7-4469-b748-80cc52825bb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:14.322330 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-202cb1f7-1eaf-4a26-956a-33ad6ac537c3 req-616fcfb3-c7b5-4eb0-8b36-877290d18502 service nova] Lock "1b412363-2fb7-4469-b748-80cc52825bb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:14.322378 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-202cb1f7-1eaf-4a26-956a-33ad6ac537c3 req-616fcfb3-c7b5-4eb0-8b36-877290d18502 service nova] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] No waiting events found dispatching network-vif-unplugged-53b9a3dd-c125-4e7b-b3ee-9debd47394dd {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:14.322916 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-202cb1f7-1eaf-4a26-956a-33ad6ac537c3 req-616fcfb3-c7b5-4eb0-8b36-877290d18502 service nova] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Received event network-vif-unplugged-53b9a3dd-c125-4e7b-b3ee-9debd47394dd for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:14.403746 np0000003587 nova-compute[98952]: DEBUG nova.utils [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Queued Task(fn=>, remaining_delay=14.999575825000193 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:14.407778 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Instance destroyed successfully. Jun 25 04:44:14.408578 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-ba6b4e8c-b4fa-4a6e-bb87-c8fdf86db57d tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'resources' on Instance uuid 1b412363-2fb7-4469-b748-80cc52825bb5 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:44:14.510166 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Found WWN 330000000a5c943c3 for multipath device dm-18 {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 25 04:44:14.513045 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.053s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:14.513045 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] <== connect_volume: return (2053ms) {'type': 'block', 'scsi_wwn': '330000000a5c943c3', 'path': '/dev/dm-18', 'multipath_id': '330000000a5c943c3'} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:44:14.513045 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a5c943c3', 'path': '/dev/dm-18', 'multipath_id': '330000000a5c943c3'} {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 25 04:44:14.517443 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lazy-loading 'flavor' on Instance uuid 520409fb-f97c-4503-b97b-7cecd377102a {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:44:14.914653 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-ba6b4e8c-b4fa-4a6e-bb87-c8fdf86db57d tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-234069485',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-serverbootfromvolumestablerescuetest-server-234069485',id=10,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-25T04:42:50Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='a5d52ed3b8de460eb65a8fb4ad1b015d',ramdisk_id='',reservation_id='r-qe17im33',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-6878904',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:43:02Z,user_data=None,user_id='27ebe4b23b624995a52b9313ff9e318a',uuid=1b412363-2fb7-4469-b748-80cc52825bb5,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53b9a3dd-c125-4e7b-b3ee-9debd47394dd", "address": "fa:16:3e:ee:97:a2", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b9a3dd-c1", "ovs_interfaceid": "53b9a3dd-c125-4e7b-b3ee-9debd47394dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:44:14.914969 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-ba6b4e8c-b4fa-4a6e-bb87-c8fdf86db57d tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converting VIF {"id": "53b9a3dd-c125-4e7b-b3ee-9debd47394dd", "address": "fa:16:3e:ee:97:a2", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b9a3dd-c1", "ovs_interfaceid": "53b9a3dd-c125-4e7b-b3ee-9debd47394dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:14.915746 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-ba6b4e8c-b4fa-4a6e-bb87-c8fdf86db57d tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:97:a2,bridge_name='br-int',has_traffic_filtering=True,id=53b9a3dd-c125-4e7b-b3ee-9debd47394dd,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53b9a3dd-c1') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:14.916074 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-ba6b4e8c-b4fa-4a6e-bb87-c8fdf86db57d tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:97:a2,bridge_name='br-int',has_traffic_filtering=True,id=53b9a3dd-c125-4e7b-b3ee-9debd47394dd,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53b9a3dd-c1') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:44:14.918349 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:14.918943 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53b9a3dd-c1, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:14.919892 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:14.920782 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:14.921699 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:14.922619 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:14.922870 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f219426f-593d-4ac8-87ea-e0efe257b348) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:14.923745 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:14.925190 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:14.927635 np0000003587 nova-compute[98952]: INFO os_vif [None req-ba6b4e8c-b4fa-4a6e-bb87-c8fdf86db57d tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:97:a2,bridge_name='br-int',has_traffic_filtering=True,id=53b9a3dd-c125-4e7b-b3ee-9debd47394dd,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53b9a3dd-c1') Jun 25 04:44:14.928173 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-ba6b4e8c-b4fa-4a6e-bb87-c8fdf86db57d tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Deleting instance files /opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5_del Jun 25 04:44:14.929281 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-ba6b4e8c-b4fa-4a6e-bb87-c8fdf86db57d tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Deletion of /opt/stack/data/nova/instances/1b412363-2fb7-4469-b748-80cc52825bb5_del complete Jun 25 04:44:14.954648 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:15.023011 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Attempting to attach volume 89748225-9d41-4fb1-b47a-f0f88aa6ebfa with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98952) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 25 04:44:15.024654 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] attach device xml: Jun 25 04:44:15.024654 np0000003587 nova-compute[98952]: Jun 25 04:44:15.024654 np0000003587 nova-compute[98952]: Jun 25 04:44:15.024654 np0000003587 nova-compute[98952]: Jun 25 04:44:15.024654 np0000003587 nova-compute[98952]: Jun 25 04:44:15.024654 np0000003587 nova-compute[98952]: 89748225-9d41-4fb1-b47a-f0f88aa6ebfa Jun 25 04:44:15.024654 np0000003587 nova-compute[98952]: Jun 25 04:44:15.024654 np0000003587 nova-compute[98952]: Jun 25 04:44:15.024654 np0000003587 nova-compute[98952]: {{(pid=98952) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 25 04:44:15.443737 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-ba6b4e8c-b4fa-4a6e-bb87-c8fdf86db57d tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Took 1.41 seconds to destroy the instance on the hypervisor. Jun 25 04:44:15.444899 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._common.loopingcall [None req-ba6b4e8c-b4fa-4a6e-bb87-c8fdf86db57d tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98952) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 25 04:44:15.445383 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [-] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Deallocating network for instance {{(pid=98952) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 25 04:44:15.446140 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] deallocate_for_instance() {{(pid=98952) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 25 04:44:15.446678 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:15.515823 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-45b9af02-c973-48f0-a9e0-5216b23bc3b2 req-703d3962-6867-45a8-a129-ebc0c570368b service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-deleted-789bf2ca-f86e-403a-88a3-0103291a84df {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:15.516408 np0000003587 nova-compute[98952]: INFO nova.compute.manager [req-45b9af02-c973-48f0-a9e0-5216b23bc3b2 req-703d3962-6867-45a8-a129-ebc0c570368b service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Neutron deleted interface 789bf2ca-f86e-403a-88a3-0103291a84df; detaching it from the instance and deleting it from the info cache Jun 25 04:44:15.518508 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-45b9af02-c973-48f0-a9e0-5216b23bc3b2 req-703d3962-6867-45a8-a129-ebc0c570368b service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Detach interface failed, port_id=789bf2ca-f86e-403a-88a3-0103291a84df, reason: Instance 9c033870-f167-4235-86ff-98005452a16c could not be found. {{(pid=98952) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 25 04:44:15.536174 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-a3f27dbe-3642-45cc-9bba-f94ba16be6ba req-f7489185-cbbf-411c-8147-ab90f61ff731 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-deleted-e12da27e-2953-4784-80b6-5f7204f4e399 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:15.536613 np0000003587 nova-compute[98952]: INFO nova.compute.manager [req-a3f27dbe-3642-45cc-9bba-f94ba16be6ba req-f7489185-cbbf-411c-8147-ab90f61ff731 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Neutron deleted interface e12da27e-2953-4784-80b6-5f7204f4e399; detaching it from the instance and deleting it from the info cache Jun 25 04:44:15.539005 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-a3f27dbe-3642-45cc-9bba-f94ba16be6ba req-f7489185-cbbf-411c-8147-ab90f61ff731 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Detach interface failed, port_id=e12da27e-2953-4784-80b6-5f7204f4e399, reason: Instance 9c033870-f167-4235-86ff-98005452a16c could not be found. {{(pid=98952) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 25 04:44:15.549686 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:16.101120 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:16.334512 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: 9c033870-f167-4235-86ff-98005452a16c] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:44:16.428728 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1368df38-563a-4d0b-b1de-6117e0f43e19 req-10dc00bc-5e05-4ce2-995e-287b88258903 service nova] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Received event network-vif-unplugged-53b9a3dd-c125-4e7b-b3ee-9debd47394dd {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:16.428910 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1368df38-563a-4d0b-b1de-6117e0f43e19 req-10dc00bc-5e05-4ce2-995e-287b88258903 service nova] Acquiring lock "1b412363-2fb7-4469-b748-80cc52825bb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:16.429133 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1368df38-563a-4d0b-b1de-6117e0f43e19 req-10dc00bc-5e05-4ce2-995e-287b88258903 service nova] Lock "1b412363-2fb7-4469-b748-80cc52825bb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:16.429274 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1368df38-563a-4d0b-b1de-6117e0f43e19 req-10dc00bc-5e05-4ce2-995e-287b88258903 service nova] Lock "1b412363-2fb7-4469-b748-80cc52825bb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:16.430145 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1368df38-563a-4d0b-b1de-6117e0f43e19 req-10dc00bc-5e05-4ce2-995e-287b88258903 service nova] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] No waiting events found dispatching network-vif-unplugged-53b9a3dd-c125-4e7b-b3ee-9debd47394dd {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:16.430145 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1368df38-563a-4d0b-b1de-6117e0f43e19 req-10dc00bc-5e05-4ce2-995e-287b88258903 service nova] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Received event network-vif-unplugged-53b9a3dd-c125-4e7b-b3ee-9debd47394dd for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:16.432676 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:44:16.719370 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:16.719370 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:16.719370 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:16.719370 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No VIF found with MAC fa:16:3e:55:5b:09, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:44:16.839332 np0000003587 nova-compute[98952]: INFO nova.compute.manager [-] [instance: 9c033870-f167-4235-86ff-98005452a16c] Took 5.54 seconds to deallocate network for instance. Jun 25 04:44:16.937508 np0000003587 nova-compute[98952]: INFO nova.compute.manager [-] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Took 1.49 seconds to deallocate network for instance. Jun 25 04:44:17.068245 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:17.438782 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00048581500004729605 future=) submitted to {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:17.439874 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:17.442059 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.5094916049999938 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:17.442059 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=0.5088669270000992 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:17.445107 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Emitting event Stopped> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:44:17.445107 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] VM Stopped (Lifecycle Event) Jun 25 04:44:17.451173 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ba6b4e8c-b4fa-4a6e-bb87-c8fdf86db57d tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:17.451173 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ba6b4e8c-b4fa-4a6e-bb87-c8fdf86db57d tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:17.640215 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-49089da2-0242-48f3-a658-abb25a88fac2 req-a4f4e15e-24a5-4704-a739-d8188a7c3bf3 service nova] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Received event network-vif-deleted-53b9a3dd-c125-4e7b-b3ee-9debd47394dd {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:17.641208 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-e87b0215-843f-4f71-b470-7d14eb39b785 req-723aa217-d81f-4f79-b078-e322749451a2 service nova] [instance: 9c033870-f167-4235-86ff-98005452a16c] Received event network-vif-deleted-f002d56c-77f0-4fb0-9501-751106b08f89 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:17.947642 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: df96228c-c3b2-457d-9eb1-2e82186076f4] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:44:17.952185 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0012248779999026738 future=) submitted to {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:17.955584 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Emitting event Stopped> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:44:17.955584 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] VM Stopped (Lifecycle Event) Jun 25 04:44:17.957332 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:17.957332 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=11.445607757000062 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:17.957332 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=11.445474241000056 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:18.324542 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-841938be-0f1d-49eb-aec8-57e2832c8a93 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "520409fb-f97c-4503-b97b-7cecd377102a" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 6.647s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:18.461708 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:44:18.531132 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-ba6b4e8c-b4fa-4a6e-bb87-c8fdf86db57d tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:44:18.531261 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-ba6b4e8c-b4fa-4a6e-bb87-c8fdf86db57d tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:44:18.651148 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] [instance: 9c033870-f167-4235-86ff-98005452a16c] Took 1.81 seconds to detach 3 volumes for instance. Jun 25 04:44:19.035057 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-ba6b4e8c-b4fa-4a6e-bb87-c8fdf86db57d tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:44:19.161352 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:19.525181 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-13c4c622-c722-4150-88cd-e10fd636b9db req-6e021be5-11c1-468b-a882-2d94274dce56 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Received event network-changed-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:19.525312 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-13c4c622-c722-4150-88cd-e10fd636b9db req-6e021be5-11c1-468b-a882-2d94274dce56 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Refreshing instance network info cache due to event network-changed-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:44:19.526574 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-13c4c622-c722-4150-88cd-e10fd636b9db req-6e021be5-11c1-468b-a882-2d94274dce56 service nova] Acquiring lock "refresh_cache-8b915629-823e-4b55-bc64-d73e58b79bdc" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:44:19.526574 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-13c4c622-c722-4150-88cd-e10fd636b9db req-6e021be5-11c1-468b-a882-2d94274dce56 service nova] Acquired lock "refresh_cache-8b915629-823e-4b55-bc64-d73e58b79bdc" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:44:19.526574 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-13c4c622-c722-4150-88cd-e10fd636b9db req-6e021be5-11c1-468b-a882-2d94274dce56 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Refreshing network info cache for port 4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:44:19.546649 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ba6b4e8c-b4fa-4a6e-bb87-c8fdf86db57d tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.093s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:19.547456 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.384s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:19.655342 np0000003587 nova-compute[98952]: INFO nova.scheduler.client.report [None req-ba6b4e8c-b4fa-4a6e-bb87-c8fdf86db57d tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Deleted allocations for instance 1b412363-2fb7-4469-b748-80cc52825bb5 Jun 25 04:44:19.864319 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:19.925584 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:19.957691 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:20.035580 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-13c4c622-c722-4150-88cd-e10fd636b9db req-6e021be5-11c1-468b-a882-2d94274dce56 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:20.624120 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:44:20.624120 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:44:20.674549 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-ba6b4e8c-b4fa-4a6e-bb87-c8fdf86db57d tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "1b412363-2fb7-4469-b748-80cc52825bb5" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.150s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:20.701200 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-13c4c622-c722-4150-88cd-e10fd636b9db req-6e021be5-11c1-468b-a882-2d94274dce56 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:21.014773 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-13c4c622-c722-4150-88cd-e10fd636b9db req-6e021be5-11c1-468b-a882-2d94274dce56 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Updated VIF entry in instance network info cache for port 4ea2b8f9-a162-4e7a-a47a-0683ae39bacf. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:44:21.014773 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-13c4c622-c722-4150-88cd-e10fd636b9db req-6e021be5-11c1-468b-a882-2d94274dce56 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Updating instance_info_cache with network_info: [{"id": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "address": "fa:16:3e:01:4b:19", "network": {"id": "42b56fcf-0521-41b0-90c0-19763fa22d07", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-808831530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "531c29726a504313bae3835b93c9c5eb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea2b8f9-a1", "ovs_interfaceid": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:44:21.128480 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:44:21.366043 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "9aa3370c-9525-460d-b6fc-40a6461bd725" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:21.366267 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:21.366504 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:21.366975 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:21.366975 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:21.372753 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Terminating instance Jun 25 04:44:21.518094 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-13c4c622-c722-4150-88cd-e10fd636b9db req-6e021be5-11c1-468b-a882-2d94274dce56 service nova] Releasing lock "refresh_cache-8b915629-823e-4b55-bc64-d73e58b79bdc" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:44:21.639953 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.094s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:21.705509 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Stashing vm_state: active {{(pid=98952) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}} Jun 25 04:44:21.726230 np0000003587 nova-compute[98952]: INFO nova.scheduler.client.report [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Deleted allocations for instance 9c033870-f167-4235-86ff-98005452a16c Jun 25 04:44:21.882985 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Start destroying the instance on the hypervisor. {{(pid=98952) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 25 04:44:21.917941 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:21.929743 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:21.953758 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:22.167961 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:22.178686 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:22.268215 np0000003587 nova-compute[98952]: DEBUG nova.utils [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Queued Task(fn=>, remaining_delay=14.99845624999989 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:22.271874 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-e0aa6ed8-7573-42c5-9d7e-0928e055712f req-f41bf0ac-7c07-4d9f-9beb-a70b5a65c34b service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Received event network-vif-unplugged-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:22.272328 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-e0aa6ed8-7573-42c5-9d7e-0928e055712f req-f41bf0ac-7c07-4d9f-9beb-a70b5a65c34b service nova] Acquiring lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:22.273649 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-e0aa6ed8-7573-42c5-9d7e-0928e055712f req-f41bf0ac-7c07-4d9f-9beb-a70b5a65c34b service nova] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:22.273649 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-e0aa6ed8-7573-42c5-9d7e-0928e055712f req-f41bf0ac-7c07-4d9f-9beb-a70b5a65c34b service nova] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:22.273649 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-e0aa6ed8-7573-42c5-9d7e-0928e055712f req-f41bf0ac-7c07-4d9f-9beb-a70b5a65c34b service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] No waiting events found dispatching network-vif-unplugged-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:22.273970 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-e0aa6ed8-7573-42c5-9d7e-0928e055712f req-f41bf0ac-7c07-4d9f-9beb-a70b5a65c34b service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Received event network-vif-unplugged-62e285cd-c2d8-4883-a400-d57367b20980 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:22.275031 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Instance destroyed successfully. Jun 25 04:44:22.275992 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'resources' on Instance uuid 9aa3370c-9525-460d-b6fc-40a6461bd725 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:44:22.312115 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:22.312654 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:22.747550 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-7cae372c-ec41-4ef0-a298-227af4a1d677 tempest-TaggedBootDevicesTest_v242-479660225 tempest-TaggedBootDevicesTest_v242-479660225-project-member] Lock "9c033870-f167-4235-86ff-98005452a16c" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 21.191s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:22.785690 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:41:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1691757098',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-serverbootfromvolumestablerescuetest-server-1691757098',id=7,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-25T04:42:28Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='a5d52ed3b8de460eb65a8fb4ad1b015d',ramdisk_id='',reservation_id='r-8umk47p3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-6878904',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:42:34Z,user_data=None,user_id='27ebe4b23b624995a52b9313ff9e318a',uuid=9aa3370c-9525-460d-b6fc-40a6461bd725,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62e285cd-c2d8-4883-a400-d57367b20980", "address": "fa:16:3e:e6:e0:22", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e285cd-c2", "ovs_interfaceid": "62e285cd-c2d8-4883-a400-d57367b20980", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:44:22.786077 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converting VIF {"id": "62e285cd-c2d8-4883-a400-d57367b20980", "address": "fa:16:3e:e6:e0:22", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e285cd-c2", "ovs_interfaceid": "62e285cd-c2d8-4883-a400-d57367b20980", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:22.786953 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:e0:22,bridge_name='br-int',has_traffic_filtering=True,id=62e285cd-c2d8-4883-a400-d57367b20980,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62e285cd-c2') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:22.786953 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:e0:22,bridge_name='br-int',has_traffic_filtering=True,id=62e285cd-c2d8-4883-a400-d57367b20980,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62e285cd-c2') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:44:22.788831 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:22.789100 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62e285cd-c2, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:22.793786 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:22.796760 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:22.796961 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:22.797090 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c181ac9-3069-4e2a-9c9e-be5a15dac4f5) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:22.799705 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:22.800353 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:22.804378 np0000003587 nova-compute[98952]: INFO os_vif [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:e0:22,bridge_name='br-int',has_traffic_filtering=True,id=62e285cd-c2d8-4883-a400-d57367b20980,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62e285cd-c2') Jun 25 04:44:22.806142 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] calling os-brick to detach iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 25 04:44:22.806656 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:44:22.807767 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:22.808111 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:22.809102 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 25 04:44:22.809102 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', 0)] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 25 04:44:22.822739 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:44:22.822949 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Claim successful on node np0000003587 Jun 25 04:44:22.864441 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:22.864441 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:22.864441 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:22.864441 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:22.864441 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:22.864441 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:22.864441 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:22.864441 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:22.864441 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:22.864441 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:22.864441 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:22.864441 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:22.864441 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:22.864441 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:22.864441 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:22.865456 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsi session list stdout=tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:22.865456 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:22.865456 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:22.865456 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:22.865456 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:22.865456 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:22.865456 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:22.865456 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:22.865456 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:22.865456 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:22.865456 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:22.865456 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:22.865456 np0000003587 nova-compute[98952]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:22.865456 np0000003587 nova-compute[98952]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6 (non-flash) Jun 25 04:44:22.865456 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:22.865456 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', '6')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 25 04:44:22.865456 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', '5')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:44:22.869273 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6', '6')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:44:22.870316 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Resulting device map defaultdict(. at 0x7a16b8404cc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6'): ({'sde'}, set())}) {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 25 04:44:22.871051 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Removing multipathed devices sde, sdd {{(pid=98952) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 25 04:44:22.871051 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Flush multipath device 33000000029752971 {{(pid=98952) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 25 04:44:22.924505 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:44:22.967232 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:44:23.008882 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 25 04:44:23.009927 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 25 04:44:23.011654 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 25 04:44:23.025837 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 25 04:44:23.026142 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6')] {{(pid=98952) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 25 04:44:23.042601 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:23.091331 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6, portal: 192.168.40.100,3260] Jun 25 04:44:23.091331 np0000003587 nova-compute[98952]: Logout of [sid: 5, target: iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6, portal: 192.168.40.100,3260] successful. Jun 25 04:44:23.091331 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:23.121188 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:23.136488 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:23.178057 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6, portal: 192.168.50.100,3260] Jun 25 04:44:23.178057 np0000003587 nova-compute[98952]: Logout of [sid: 6, target: iqn.2023-03.storpool.com:os--volume-9ed7fd1c-6933-4549-8acc-d425cd2d10a6, portal: 192.168.50.100,3260] successful. Jun 25 04:44:23.178057 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:23.205679 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:23.205925 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:23.206152 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] <== disconnect_volume: return (398ms) None {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:44:23.206279 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Disconnected iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 25 04:44:23.206670 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Deleting instance files /opt/stack/data/nova/instances/9aa3370c-9525-460d-b6fc-40a6461bd725_del Jun 25 04:44:23.207207 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Deletion of /opt/stack/data/nova/instances/9aa3370c-9525-460d-b6fc-40a6461bd725_del complete Jun 25 04:44:23.336753 np0000003587 nova-compute[98952]: INFO nova.compute.resource_tracker [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Updating resource usage from migration 767fda44-409a-415f-9e90-060b3e04c126 Jun 25 04:44:23.722118 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Took 1.84 seconds to destroy the instance on the hypervisor. Jun 25 04:44:23.724304 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._common.loopingcall [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98952) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 25 04:44:23.728811 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [-] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Deallocating network for instance {{(pid=98952) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 25 04:44:23.729778 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] deallocate_for_instance() {{(pid=98952) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 25 04:44:23.729778 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:23.857061 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:24.054766 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:24.247489 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:44:24.248107 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:44:24.400790 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-4fa9f2e6-a7d9-4509-9ec6-83cdadfb6bd1 req-4a03cf93-cb15-4006-8251-aaca4900087d service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Received event network-vif-unplugged-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:24.403525 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4fa9f2e6-a7d9-4509-9ec6-83cdadfb6bd1 req-4a03cf93-cb15-4006-8251-aaca4900087d service nova] Acquiring lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:24.405840 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4fa9f2e6-a7d9-4509-9ec6-83cdadfb6bd1 req-4a03cf93-cb15-4006-8251-aaca4900087d service nova] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.003s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:24.406054 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4fa9f2e6-a7d9-4509-9ec6-83cdadfb6bd1 req-4a03cf93-cb15-4006-8251-aaca4900087d service nova] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:24.406289 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-4fa9f2e6-a7d9-4509-9ec6-83cdadfb6bd1 req-4a03cf93-cb15-4006-8251-aaca4900087d service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] No waiting events found dispatching network-vif-unplugged-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:24.406415 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-4fa9f2e6-a7d9-4509-9ec6-83cdadfb6bd1 req-4a03cf93-cb15-4006-8251-aaca4900087d service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Received event network-vif-unplugged-62e285cd-c2d8-4883-a400-d57367b20980 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:24.407087 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-4fa9f2e6-a7d9-4509-9ec6-83cdadfb6bd1 req-4a03cf93-cb15-4006-8251-aaca4900087d service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Received event network-changed-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:24.408081 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-4fa9f2e6-a7d9-4509-9ec6-83cdadfb6bd1 req-4a03cf93-cb15-4006-8251-aaca4900087d service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Refreshing instance network info cache due to event network-changed-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:44:24.408610 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4fa9f2e6-a7d9-4509-9ec6-83cdadfb6bd1 req-4a03cf93-cb15-4006-8251-aaca4900087d service nova] Acquiring lock "refresh_cache-8b915629-823e-4b55-bc64-d73e58b79bdc" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:44:24.410326 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4fa9f2e6-a7d9-4509-9ec6-83cdadfb6bd1 req-4a03cf93-cb15-4006-8251-aaca4900087d service nova] Acquired lock "refresh_cache-8b915629-823e-4b55-bc64-d73e58b79bdc" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:44:24.410546 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-4fa9f2e6-a7d9-4509-9ec6-83cdadfb6bd1 req-4a03cf93-cb15-4006-8251-aaca4900087d service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Refreshing network info cache for port 4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:44:24.453165 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-afda292f-b5b4-485e-886f-5a1ad2296bdc req-bd89d0ba-b314-4e89-b485-53b5a312c19b service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Received event network-vif-deleted-62e285cd-c2d8-4883-a400-d57367b20980 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:24.453755 np0000003587 nova-compute[98952]: INFO nova.compute.manager [req-afda292f-b5b4-485e-886f-5a1ad2296bdc req-bd89d0ba-b314-4e89-b485-53b5a312c19b service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Neutron deleted interface 62e285cd-c2d8-4883-a400-d57367b20980; detaching it from the instance and deleting it from the info cache Jun 25 04:44:24.456258 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-afda292f-b5b4-485e-886f-5a1ad2296bdc req-bd89d0ba-b314-4e89-b485-53b5a312c19b service nova] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Detach interface failed, port_id=62e285cd-c2d8-4883-a400-d57367b20980, reason: Instance 9aa3370c-9525-460d-b6fc-40a6461bd725 could not be found. {{(pid=98952) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 25 04:44:24.752830 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:44:24.866148 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:44:24.918712 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-4fa9f2e6-a7d9-4509-9ec6-83cdadfb6bd1 req-4a03cf93-cb15-4006-8251-aaca4900087d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:24.965851 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:25.260928 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.948s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:25.261454 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Migrating Jun 25 04:44:25.261454 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:44:25.261692 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquired lock "compute-rpcapi-router" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:44:25.368895 np0000003587 nova-compute[98952]: INFO nova.compute.manager [-] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Took 1.64 seconds to deallocate network for instance. Jun 25 04:44:25.418063 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-4fa9f2e6-a7d9-4509-9ec6-83cdadfb6bd1 req-4a03cf93-cb15-4006-8251-aaca4900087d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:25.680810 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-4fa9f2e6-a7d9-4509-9ec6-83cdadfb6bd1 req-4a03cf93-cb15-4006-8251-aaca4900087d service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Updated VIF entry in instance network info cache for port 4ea2b8f9-a162-4e7a-a47a-0683ae39bacf. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:44:25.681239 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-4fa9f2e6-a7d9-4509-9ec6-83cdadfb6bd1 req-4a03cf93-cb15-4006-8251-aaca4900087d service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Updating instance_info_cache with network_info: [{"id": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "address": "fa:16:3e:01:4b:19", "network": {"id": "42b56fcf-0521-41b0-90c0-19763fa22d07", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-808831530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "531c29726a504313bae3835b93c9c5eb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea2b8f9-a1", "ovs_interfaceid": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:44:25.765982 np0000003587 nova-compute[98952]: INFO nova.compute.rpcapi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Automatically selected compute RPC version 6.5 from minimum service version 72 Jun 25 04:44:25.766857 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Releasing lock "compute-rpcapi-router" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:44:25.766857 np0000003587 nova-compute[98952]: DEBUG nova.compute.rpcapi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98952) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 25 04:44:25.995524 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Took 0.62 seconds to detach 1 volumes for instance. Jun 25 04:44:25.999639 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Deleting volume: 9ed7fd1c-6933-4549-8acc-d425cd2d10a6 {{(pid=98952) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}} Jun 25 04:44:26.185149 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4fa9f2e6-a7d9-4509-9ec6-83cdadfb6bd1 req-4a03cf93-cb15-4006-8251-aaca4900087d service nova] Releasing lock "refresh_cache-8b915629-823e-4b55-bc64-d73e58b79bdc" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:44:26.296972 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "refresh_cache-ea0f9737-865a-4199-9077-b64e88af15db" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:44:26.296972 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquired lock "refresh_cache-ea0f9737-865a-4199-9077-b64e88af15db" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:44:26.297550 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:44:26.568340 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:26.568524 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:26.765675 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:26.803426 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:27.320832 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:27.440305 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:44:27.440305 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:44:27.474256 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Acquiring lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:27.474256 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:27.565233 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Updating instance_info_cache with network_info: [{"id": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "address": "fa:16:3e:57:c0:7f", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa68140e2-5c", "ovs_interfaceid": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:44:27.798130 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:27.943583 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:44:27.977055 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:44:28.068058 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Releasing lock "refresh_cache-ea0f9737-865a-4199-9077-b64e88af15db" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:44:28.451720 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.883s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:28.543343 np0000003587 nova-compute[98952]: INFO nova.scheduler.client.report [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Deleted allocations for instance 9aa3370c-9525-460d-b6fc-40a6461bd725 Jun 25 04:44:28.552447 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:28.553003 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:28.556096 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:44:28.556334 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Claim successful on node np0000003587 Jun 25 04:44:29.403070 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005229579999195266 future=) submitted to {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:29.403910 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] Emitting event Stopped> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:44:29.404270 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:29.404652 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] VM Stopped (Lifecycle Event) Jun 25 04:44:29.406465 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=7.8602250659998845 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:29.406744 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=7.859947612000042 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:29.555199 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2027a19c-1d41-4650-9a0f-baa1ad17ebbd tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "9aa3370c-9525-460d-b6fc-40a6461bd725" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.188s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:29.587401 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Starting migrate_disk_and_power_off {{(pid=98952) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12621}} Jun 25 04:44:29.613865 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:29.625726 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:29.650716 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:29.814083 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:29.830719 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:29.909371 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-80e0c4ef-15ca-4f34-ad5f-8af220d8c9de tempest-DeleteServersTestJSON-91450344 tempest-DeleteServersTestJSON-91450344-project-member] [instance: 1b412363-2fb7-4469-b748-80cc52825bb5] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:44:29.910787 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:29.928026 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:29.961244 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-94e336eb-5746-47ca-b916-f564e0ef5c81 req-8cde3f8d-38b5-4199-81d5-8c004478a1cb service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Received event network-vif-unplugged-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:29.961738 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-94e336eb-5746-47ca-b916-f564e0ef5c81 req-8cde3f8d-38b5-4199-81d5-8c004478a1cb service nova] Acquiring lock "ea0f9737-865a-4199-9077-b64e88af15db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:29.962028 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-94e336eb-5746-47ca-b916-f564e0ef5c81 req-8cde3f8d-38b5-4199-81d5-8c004478a1cb service nova] Lock "ea0f9737-865a-4199-9077-b64e88af15db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:29.962387 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-94e336eb-5746-47ca-b916-f564e0ef5c81 req-8cde3f8d-38b5-4199-81d5-8c004478a1cb service nova] Lock "ea0f9737-865a-4199-9077-b64e88af15db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:29.962651 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-94e336eb-5746-47ca-b916-f564e0ef5c81 req-8cde3f8d-38b5-4199-81d5-8c004478a1cb service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] No waiting events found dispatching network-vif-unplugged-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:29.962951 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-94e336eb-5746-47ca-b916-f564e0ef5c81 req-8cde3f8d-38b5-4199-81d5-8c004478a1cb service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Received unexpected event network-vif-unplugged-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 for instance with vm_state active and task_state resize_migrating. Jun 25 04:44:29.966687 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:29.974704 np0000003587 nova-compute[98952]: DEBUG nova.utils [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Queued Task(fn=>, remaining_delay=14.999740379000059 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:29.986936 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Instance destroyed successfully. Jun 25 04:44:29.987897 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:43:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='multiattach-server-0',id=13,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV/p3ZeuUk+pDtRyjEqB6LGacp/8M+rMj60nbQpQu7IIRoy9lFRhD1vsgSIFDZ+PjS4ytFpGVQZ3frW+0uH/J+qnA92sFXepo+od7tCOydqRChW2tpsraqZi+iIk6G08A==',key_name='tempest-keypair-462979399',keypairs=,launch_index=0,launched_at=2026-06-25T04:43:29Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='284d191aa82f453cabcfd18172f74099',ramdisk_id='',reservation_id='r-z9bdjah6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1256899935',owner_user_name='tempest-AttachVolumeMultiAttachTest-1256899935-project-member'},tags=,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:44:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='947bde0e827c45f5bab008d094816d8c',uuid=ea0f9737-865a-4199-9077-b64e88af15db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "address": "fa:16:3e:57:c0:7f", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "vif_mac": "fa:16:3e:57:c0:7f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa68140e2-5c", "ovs_interfaceid": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:44:29.988089 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converting VIF {"id": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "address": "fa:16:3e:57:c0:7f", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "vif_mac": "fa:16:3e:57:c0:7f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa68140e2-5c", "ovs_interfaceid": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:29.988688 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:c0:7f,bridge_name='br-int',has_traffic_filtering=True,id=a68140e2-5c7f-49c9-abbb-fbc11cf20cf2,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa68140e2-5c') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:29.989320 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:c0:7f,bridge_name='br-int',has_traffic_filtering=True,id=a68140e2-5c7f-49c9-abbb-fbc11cf20cf2,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa68140e2-5c') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:44:29.990336 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:29.990894 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa68140e2-5c, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:29.995815 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:29.997858 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:30.000171 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:30.000171 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=69465cdf-6a31-447e-bd17-cf99ad7331d0) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:30.001977 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:30.002287 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:30.004320 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:30.007054 np0000003587 nova-compute[98952]: INFO os_vif [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:c0:7f,bridge_name='br-int',has_traffic_filtering=True,id=a68140e2-5c7f-49c9-abbb-fbc11cf20cf2,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa68140e2-5c') Jun 25 04:44:30.466681 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:44:30.467047 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:44:30.586188 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Detected multiple connections on this host for volume: 89748225-9d41-4fb1-b47a-f0f88aa6ebfa, skipping target disconnect. Jun 25 04:44:30.591260 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:30.703776 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:30.703969 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:30.822023 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:30.823308 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] skipping disk /dev/dm-18 (vdb) as it is a volume {{(pid=98952) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 25 04:44:30.826020 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db_resize/disk /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:30.961837 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "cp -r /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db_resize/disk /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk" returned: 0 in 0.136s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:30.963097 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db_resize/disk.config /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk.config {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:30.986758 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:44:31.012456 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "cp -r /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db_resize/disk.config /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk.config" returned: 0 in 0.050s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:31.014431 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db_resize/disk.info /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk.info {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:31.062264 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "cp -r /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db_resize/disk.info /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk.info" returned: 0 in 0.049s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:31.062960 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Acquiring lock "2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:31.063278 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Lock "2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:31.279813 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-aa930782-9646-4e44-8a10-8519d81ff9c3 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "11145d6a-7a4f-4b00-8543-d9b51514d9de" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:31.280395 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-aa930782-9646-4e44-8a10-8519d81ff9c3 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "11145d6a-7a4f-4b00-8543-d9b51514d9de" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:31.280395 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-aa930782-9646-4e44-8a10-8519d81ff9c3 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "11145d6a-7a4f-4b00-8543-d9b51514d9de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:31.280395 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-aa930782-9646-4e44-8a10-8519d81ff9c3 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "11145d6a-7a4f-4b00-8543-d9b51514d9de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:31.280767 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-aa930782-9646-4e44-8a10-8519d81ff9c3 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "11145d6a-7a4f-4b00-8543-d9b51514d9de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:31.284881 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-aa930782-9646-4e44-8a10-8519d81ff9c3 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Terminating instance Jun 25 04:44:31.504111 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.951s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:31.504835 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:44:31.570585 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:44:31.790988 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-aa930782-9646-4e44-8a10-8519d81ff9c3 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Start destroying the instance on the hypervisor. {{(pid=98952) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 25 04:44:31.823728 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:31.849280 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:31.858013 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:31.882384 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:32.016282 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:44:32.016547 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:44:32.017338 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:32.017701 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:32.084585 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-21f04615-157c-4d6a-89f6-90d47f98fbb8 req-8c401144-9e53-45cb-a7ae-1f05237d66ba service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Received event network-vif-unplugged-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:32.084585 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-21f04615-157c-4d6a-89f6-90d47f98fbb8 req-8c401144-9e53-45cb-a7ae-1f05237d66ba service nova] Acquiring lock "ea0f9737-865a-4199-9077-b64e88af15db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:32.084585 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-21f04615-157c-4d6a-89f6-90d47f98fbb8 req-8c401144-9e53-45cb-a7ae-1f05237d66ba service nova] Lock "ea0f9737-865a-4199-9077-b64e88af15db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:32.084585 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-21f04615-157c-4d6a-89f6-90d47f98fbb8 req-8c401144-9e53-45cb-a7ae-1f05237d66ba service nova] Lock "ea0f9737-865a-4199-9077-b64e88af15db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:32.084585 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-21f04615-157c-4d6a-89f6-90d47f98fbb8 req-8c401144-9e53-45cb-a7ae-1f05237d66ba service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] No waiting events found dispatching network-vif-unplugged-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:32.084585 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-21f04615-157c-4d6a-89f6-90d47f98fbb8 req-8c401144-9e53-45cb-a7ae-1f05237d66ba service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Received unexpected event network-vif-unplugged-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 for instance with vm_state active and task_state resize_migrating. Jun 25 04:44:32.122250 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5da5f5d0548e4d11b82042832880176d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c4d7e8a6f4b7e8fbefeb88f1f4022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:44:32.139308 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:32.139308 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:32.146369 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:44:32.146779 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Claim successful on node np0000003587 Jun 25 04:44:32.160157 np0000003587 nova-compute[98952]: DEBUG nova.utils [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Queued Task(fn=>, remaining_delay=14.999658427999975 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:32.161692 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Instance destroyed successfully. Jun 25 04:44:32.162052 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-aa930782-9646-4e44-8a10-8519d81ff9c3 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lazy-loading 'resources' on Instance uuid 11145d6a-7a4f-4b00-8543-d9b51514d9de {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:44:32.278165 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:32.278830 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:32.371801 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Port a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 binding to destination host np0000003587 is already ACTIVE {{(pid=98952) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} Jun 25 04:44:32.520624 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 25 04:44:32.590732 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:32.664935 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-aa930782-9646-4e44-8a10-8519d81ff9c3 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:41:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2130958277',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-serverbootfromvolumestablerescuetest-server-2130958277',id=1,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-25T04:41:31Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='a5d52ed3b8de460eb65a8fb4ad1b015d',ramdisk_id='',reservation_id='r-s6lu4wsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-6878904',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:41:43Z,user_data=None,user_id='27ebe4b23b624995a52b9313ff9e318a',uuid=11145d6a-7a4f-4b00-8543-d9b51514d9de,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16a2d9c6-253c-4ce0-84cf-2bfd90c87576", "address": "fa:16:3e:8c:f8:83", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a2d9c6-25", "ovs_interfaceid": "16a2d9c6-253c-4ce0-84cf-2bfd90c87576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:44:32.665247 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-aa930782-9646-4e44-8a10-8519d81ff9c3 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converting VIF {"id": "16a2d9c6-253c-4ce0-84cf-2bfd90c87576", "address": "fa:16:3e:8c:f8:83", "network": {"id": "d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-734791480-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a5d52ed3b8de460eb65a8fb4ad1b015d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap16a2d9c6-25", "ovs_interfaceid": "16a2d9c6-253c-4ce0-84cf-2bfd90c87576", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:32.665729 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-aa930782-9646-4e44-8a10-8519d81ff9c3 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f8:83,bridge_name='br-int',has_traffic_filtering=True,id=16a2d9c6-253c-4ce0-84cf-2bfd90c87576,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a2d9c6-25') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:32.665986 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-aa930782-9646-4e44-8a10-8519d81ff9c3 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f8:83,bridge_name='br-int',has_traffic_filtering=True,id=16a2d9c6-253c-4ce0-84cf-2bfd90c87576,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a2d9c6-25') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:44:32.667345 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:32.667547 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16a2d9c6-25, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:32.671871 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:32.673259 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:32.675437 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:32.676115 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b38a9ef-3e97-49aa-89d3-4cfbee89c13c) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:32.680507 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:32.682543 np0000003587 nova-compute[98952]: INFO os_vif [None req-aa930782-9646-4e44-8a10-8519d81ff9c3 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f8:83,bridge_name='br-int',has_traffic_filtering=True,id=16a2d9c6-253c-4ce0-84cf-2bfd90c87576,network=Network(d78d20a3-f651-4ba1-8f0f-7aae2bbdd7b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16a2d9c6-25') Jun 25 04:44:32.682543 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-aa930782-9646-4e44-8a10-8519d81ff9c3 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Deleting instance files /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de_del Jun 25 04:44:32.683403 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-aa930782-9646-4e44-8a10-8519d81ff9c3 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Deletion of /opt/stack/data/nova/instances/11145d6a-7a4f-4b00-8543-d9b51514d9de_del complete Jun 25 04:44:32.904909 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Successfully created port: e58dc647-6432-4d80-82f6-4917696714ba {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:44:33.025633 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Start building block device mappings for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 25 04:44:33.190086 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-aa930782-9646-4e44-8a10-8519d81ff9c3 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Took 1.40 seconds to destroy the instance on the hypervisor. Jun 25 04:44:33.190841 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._common.loopingcall [None req-aa930782-9646-4e44-8a10-8519d81ff9c3 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98952) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 25 04:44:33.191488 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [-] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Deallocating network for instance {{(pid=98952) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 25 04:44:33.191638 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] deallocate_for_instance() {{(pid=98952) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 25 04:44:33.192091 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:33.356707 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:33.382419 np0000003587 nova-compute[98952]: DEBUG nova.compute.rpcapi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98952) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 25 04:44:33.398341 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "ea0f9737-865a-4199-9077-b64e88af15db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:33.398341 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "ea0f9737-865a-4199-9077-b64e88af15db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:33.398341 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "ea0f9737-865a-4199-9077-b64e88af15db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:33.603175 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Successfully updated port: e58dc647-6432-4d80-82f6-4917696714ba {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:44:33.681036 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-43d0ef46-2b8b-4f1a-b826-a3f75e8c987d req-f56f19b6-3a0c-4da5-abca-3927a34e93c3 service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Received event network-changed-e58dc647-6432-4d80-82f6-4917696714ba {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:33.681036 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-43d0ef46-2b8b-4f1a-b826-a3f75e8c987d req-f56f19b6-3a0c-4da5-abca-3927a34e93c3 service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Refreshing instance network info cache due to event network-changed-e58dc647-6432-4d80-82f6-4917696714ba. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:44:33.681293 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-43d0ef46-2b8b-4f1a-b826-a3f75e8c987d req-f56f19b6-3a0c-4da5-abca-3927a34e93c3 service nova] Acquiring lock "refresh_cache-d0e9b114-f17b-4b1e-b8e1-b1a821f38974" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:44:33.681458 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-43d0ef46-2b8b-4f1a-b826-a3f75e8c987d req-f56f19b6-3a0c-4da5-abca-3927a34e93c3 service nova] Acquired lock "refresh_cache-d0e9b114-f17b-4b1e-b8e1-b1a821f38974" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:44:33.681645 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-43d0ef46-2b8b-4f1a-b826-a3f75e8c987d req-f56f19b6-3a0c-4da5-abca-3927a34e93c3 service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Refreshing network info cache for port e58dc647-6432-4d80-82f6-4917696714ba {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:44:33.945746 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:44:33.946245 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:44:34.036786 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Start spawning the instance on the hypervisor. {{(pid=98952) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 25 04:44:34.037640 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Creating instance directory {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 25 04:44:34.037869 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Creating image(s) Jun 25 04:44:34.038385 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0e9b114-f17b-4b1e-b8e1-b1a821f38974/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:34.038530 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "/opt/stack/data/nova/instances/d0e9b114-f17b-4b1e-b8e1-b1a821f38974/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:34.039527 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "/opt/stack/data/nova/instances/d0e9b114-f17b-4b1e-b8e1-b1a821f38974/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:34.041449 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:44:34.044910 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:44:34.046033 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:34.111641 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Acquiring lock "refresh_cache-d0e9b114-f17b-4b1e-b8e1-b1a821f38974" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:44:34.136305 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.090s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:34.136844 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Acquiring lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:34.137526 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:34.138048 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:44:34.141435 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:44:34.141777 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:34.163255 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-22ede6cf-52af-4f1e-b782-37f320ef6b00 req-ca3a2d18-a2f1-4203-9ffd-7873d93ac6e3 service nova] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Received event network-vif-unplugged-16a2d9c6-253c-4ce0-84cf-2bfd90c87576 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:34.163748 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-22ede6cf-52af-4f1e-b782-37f320ef6b00 req-ca3a2d18-a2f1-4203-9ffd-7873d93ac6e3 service nova] Acquiring lock "11145d6a-7a4f-4b00-8543-d9b51514d9de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:34.164119 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-22ede6cf-52af-4f1e-b782-37f320ef6b00 req-ca3a2d18-a2f1-4203-9ffd-7873d93ac6e3 service nova] Lock "11145d6a-7a4f-4b00-8543-d9b51514d9de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:34.164319 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-22ede6cf-52af-4f1e-b782-37f320ef6b00 req-ca3a2d18-a2f1-4203-9ffd-7873d93ac6e3 service nova] Lock "11145d6a-7a4f-4b00-8543-d9b51514d9de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:34.164513 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-22ede6cf-52af-4f1e-b782-37f320ef6b00 req-ca3a2d18-a2f1-4203-9ffd-7873d93ac6e3 service nova] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] No waiting events found dispatching network-vif-unplugged-16a2d9c6-253c-4ce0-84cf-2bfd90c87576 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:34.164731 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-22ede6cf-52af-4f1e-b782-37f320ef6b00 req-ca3a2d18-a2f1-4203-9ffd-7873d93ac6e3 service nova] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Received event network-vif-unplugged-16a2d9c6-253c-4ce0-84cf-2bfd90c87576 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:34.164865 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-22ede6cf-52af-4f1e-b782-37f320ef6b00 req-ca3a2d18-a2f1-4203-9ffd-7873d93ac6e3 service nova] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Received event network-vif-unplugged-16a2d9c6-253c-4ce0-84cf-2bfd90c87576 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:34.165051 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-22ede6cf-52af-4f1e-b782-37f320ef6b00 req-ca3a2d18-a2f1-4203-9ffd-7873d93ac6e3 service nova] Acquiring lock "11145d6a-7a4f-4b00-8543-d9b51514d9de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:34.165264 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-22ede6cf-52af-4f1e-b782-37f320ef6b00 req-ca3a2d18-a2f1-4203-9ffd-7873d93ac6e3 service nova] Lock "11145d6a-7a4f-4b00-8543-d9b51514d9de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:34.166569 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-22ede6cf-52af-4f1e-b782-37f320ef6b00 req-ca3a2d18-a2f1-4203-9ffd-7873d93ac6e3 service nova] Lock "11145d6a-7a4f-4b00-8543-d9b51514d9de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:34.166777 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-22ede6cf-52af-4f1e-b782-37f320ef6b00 req-ca3a2d18-a2f1-4203-9ffd-7873d93ac6e3 service nova] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] No waiting events found dispatching network-vif-unplugged-16a2d9c6-253c-4ce0-84cf-2bfd90c87576 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:34.166945 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-22ede6cf-52af-4f1e-b782-37f320ef6b00 req-ca3a2d18-a2f1-4203-9ffd-7873d93ac6e3 service nova] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Received event network-vif-unplugged-16a2d9c6-253c-4ce0-84cf-2bfd90c87576 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:34.167093 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-22ede6cf-52af-4f1e-b782-37f320ef6b00 req-ca3a2d18-a2f1-4203-9ffd-7873d93ac6e3 service nova] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Received event network-vif-deleted-16a2d9c6-253c-4ce0-84cf-2bfd90c87576 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:34.167289 np0000003587 nova-compute[98952]: INFO nova.compute.manager [req-22ede6cf-52af-4f1e-b782-37f320ef6b00 req-ca3a2d18-a2f1-4203-9ffd-7873d93ac6e3 service nova] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Neutron deleted interface 16a2d9c6-253c-4ce0-84cf-2bfd90c87576; detaching it from the instance and deleting it from the info cache Jun 25 04:44:34.171544 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-22ede6cf-52af-4f1e-b782-37f320ef6b00 req-ca3a2d18-a2f1-4203-9ffd-7873d93ac6e3 service nova] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Detach interface failed, port_id=16a2d9c6-253c-4ce0-84cf-2bfd90c87576, reason: Instance 11145d6a-7a4f-4b00-8543-d9b51514d9de could not be found. {{(pid=98952) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 25 04:44:34.187949 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-43d0ef46-2b8b-4f1a-b826-a3f75e8c987d req-f56f19b6-3a0c-4da5-abca-3927a34e93c3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:34.218575 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:44:34.242675 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.100s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:34.246367 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/d0e9b114-f17b-4b1e-b8e1-b1a821f38974/disk 1073741824 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:34.314300 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-43d0ef46-2b8b-4f1a-b826-a3f75e8c987d req-f56f19b6-3a0c-4da5-abca-3927a34e93c3 service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:44:34.318141 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/d0e9b114-f17b-4b1e-b8e1-b1a821f38974/disk 1073741824" returned: 0 in 0.072s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:34.318716 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.181s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:34.319283 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:34.414491 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:34.424310 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.105s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:34.427245 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d0e9b114-f17b-4b1e-b8e1-b1a821f38974/disk. size=1073741824 {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 25 04:44:34.427245 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e9b114-f17b-4b1e-b8e1-b1a821f38974/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:34.466195 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:44:34.532968 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e9b114-f17b-4b1e-b8e1-b1a821f38974/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:34.533641 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Cannot resize image /opt/stack/data/nova/instances/d0e9b114-f17b-4b1e-b8e1-b1a821f38974/disk to a smaller size. {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 25 04:44:34.534002 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Created local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 25 04:44:34.534228 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Ensure instance console log exists: /opt/stack/data/nova/instances/d0e9b114-f17b-4b1e-b8e1-b1a821f38974/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:44:34.534575 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:34.534790 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:34.534965 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:34.564364 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "refresh_cache-ea0f9737-865a-4199-9077-b64e88af15db" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:44:34.565241 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquired lock "refresh_cache-ea0f9737-865a-4199-9077-b64e88af15db" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:44:34.565508 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:44:34.583502 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-43d0ef46-2b8b-4f1a-b826-a3f75e8c987d req-f56f19b6-3a0c-4da5-abca-3927a34e93c3 service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:44:34.721906 np0000003587 nova-compute[98952]: INFO nova.compute.manager [-] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Took 1.53 seconds to deallocate network for instance. Jun 25 04:44:34.971490 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:34.978993 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.840s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:34.979449 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:44:35.070739 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:35.086614 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-43d0ef46-2b8b-4f1a-b826-a3f75e8c987d req-f56f19b6-3a0c-4da5-abca-3927a34e93c3 service nova] Releasing lock "refresh_cache-d0e9b114-f17b-4b1e-b8e1-b1a821f38974" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:44:35.087025 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Acquired lock "refresh_cache-d0e9b114-f17b-4b1e-b8e1-b1a821f38974" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:44:35.087193 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:44:35.233735 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-aa930782-9646-4e44-8a10-8519d81ff9c3 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:35.233735 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-aa930782-9646-4e44-8a10-8519d81ff9c3 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:35.239763 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:35.491836 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:44:35.492444 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:44:35.492830 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:35.493744 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:35.502679 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-f3be368e-5548-44c7-908c-81161ae46516 req-35e0fc67-1167-495e-9de1-b17f8dc5a4da service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Received event network-changed-b1dad6b2-03a7-4440-a485-a06ce1cc0802 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:35.503454 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-f3be368e-5548-44c7-908c-81161ae46516 req-35e0fc67-1167-495e-9de1-b17f8dc5a4da service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Refreshing instance network info cache due to event network-changed-b1dad6b2-03a7-4440-a485-a06ce1cc0802. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:44:35.503622 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-f3be368e-5548-44c7-908c-81161ae46516 req-35e0fc67-1167-495e-9de1-b17f8dc5a4da service nova] Acquiring lock "refresh_cache-d50f4386-5be2-4ba5-b63f-8cca28d53bbd" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:44:35.503740 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-f3be368e-5548-44c7-908c-81161ae46516 req-35e0fc67-1167-495e-9de1-b17f8dc5a4da service nova] Acquired lock "refresh_cache-d50f4386-5be2-4ba5-b63f-8cca28d53bbd" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:44:35.503862 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-f3be368e-5548-44c7-908c-81161ae46516 req-35e0fc67-1167-495e-9de1-b17f8dc5a4da service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Refreshing network info cache for port b1dad6b2-03a7-4440-a485-a06ce1cc0802 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:44:35.535402 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:35.657215 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd20284b14aaf4cb6a60843b0810d782a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50a7f42248fa403e902a08ac254c3de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:44:35.706268 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:44:35.816879 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Updating instance_info_cache with network_info: [{"id": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "address": "fa:16:3e:57:c0:7f", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa68140e2-5c", "ovs_interfaceid": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:44:35.971923 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:36.003727 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 25 04:44:36.014586 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-f3be368e-5548-44c7-908c-81161ae46516 req-35e0fc67-1167-495e-9de1-b17f8dc5a4da service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:36.158290 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "57cfae71-795b-408e-850f-5293a22274c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:36.158598 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "57cfae71-795b-408e-850f-5293a22274c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:36.253969 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Updating instance_info_cache with network_info: [{"id": "e58dc647-6432-4d80-82f6-4917696714ba", "address": "fa:16:3e:54:f0:58", "network": {"id": "778b960f-1779-4399-aec5-b9ce77e8af12", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127978990-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "394c4d7e8a6f4b7e8fbefeb88f1f4022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape58dc647-64", "ovs_interfaceid": "e58dc647-6432-4d80-82f6-4917696714ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:44:36.270392 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-aa930782-9646-4e44-8a10-8519d81ff9c3 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:44:36.271956 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-aa930782-9646-4e44-8a10-8519d81ff9c3 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:44:36.319530 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Releasing lock "refresh_cache-ea0f9737-865a-4199-9077-b64e88af15db" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:44:36.449721 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Successfully created port: a07a18ad-0e1f-46f0-94e5-0c2a44be555a {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:44:36.521150 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Start building block device mappings for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 25 04:44:36.532993 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-f3be368e-5548-44c7-908c-81161ae46516 req-35e0fc67-1167-495e-9de1-b17f8dc5a4da service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:36.671367 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lazy-loading 'flavor' on Instance uuid 57cfae71-795b-408e-850f-5293a22274c3 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:44:36.755969 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-f3be368e-5548-44c7-908c-81161ae46516 req-35e0fc67-1167-495e-9de1-b17f8dc5a4da service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Updated VIF entry in instance network info cache for port b1dad6b2-03a7-4440-a485-a06ce1cc0802. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:44:36.756404 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-f3be368e-5548-44c7-908c-81161ae46516 req-35e0fc67-1167-495e-9de1-b17f8dc5a4da service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Updating instance_info_cache with network_info: [{"id": "b1dad6b2-03a7-4440-a485-a06ce1cc0802", "address": "fa:16:3e:48:68:a7", "network": {"id": "e6f86cfa-e1c1-4b5f-a202-4fc020faa25c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-929667271-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3904801097947c79fdb5c25d592ac04", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1dad6b2-03", "ovs_interfaceid": "b1dad6b2-03a7-4440-a485-a06ce1cc0802", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:44:36.758072 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Releasing lock "refresh_cache-d0e9b114-f17b-4b1e-b8e1-b1a821f38974" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:44:36.758901 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Instance network_info: |[{"id": "e58dc647-6432-4d80-82f6-4917696714ba", "address": "fa:16:3e:54:f0:58", "network": {"id": "778b960f-1779-4399-aec5-b9ce77e8af12", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127978990-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "394c4d7e8a6f4b7e8fbefeb88f1f4022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape58dc647-64", "ovs_interfaceid": "e58dc647-6432-4d80-82f6-4917696714ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 25 04:44:36.761854 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Start _get_guest_xml network_info=[{"id": "e58dc647-6432-4d80-82f6-4917696714ba", "address": "fa:16:3e:54:f0:58", "network": {"id": "778b960f-1779-4399-aec5-b9ce77e8af12", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127978990-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "394c4d7e8a6f4b7e8fbefeb88f1f4022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape58dc647-64", "ovs_interfaceid": "e58dc647-6432-4d80-82f6-4917696714ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '4ecaf199-c1b9-4ce3-869c-178c170c1662'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:44:36.765950 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:44:36.767568 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-715977744', uuid='d0e9b114-f17b-4b1e-b8e1-b1a821f38974'), owner=OwnerMeta(userid='5da5f5d0548e4d11b82042832880176d', username='tempest-TaggedAttachmentsTest-9126716-project-member', projectid='394c4d7e8a6f4b7e8fbefeb88f1f4022', projectname='tempest-TaggedAttachmentsTest-9126716'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e58dc647-6432-4d80-82f6-4917696714ba", "address": "fa:16:3e:54:f0:58", "network": {"id": "778b960f-1779-4399-aec5-b9ce77e8af12", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127978990-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "394c4d7e8a6f4b7e8fbefeb88f1f4022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape58dc647-64", "ovs_interfaceid": "e58dc647-6432-4d80-82f6-4917696714ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362676.7670572) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:44:36.770287 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:44:36.771120 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:44:36.773225 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:44:36.773547 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:44:36.775111 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:44:36.775642 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:44:36.775858 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:44:36.775986 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:44:36.776189 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:44:36.776427 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:44:36.776644 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:44:36.776925 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:44:36.778202 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-aa930782-9646-4e44-8a10-8519d81ff9c3 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:44:36.783690 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:44:36.784111 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:44:36.787319 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:44:36.787734 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:44:36.819381 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:44:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-715977744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-715977744',id=21,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ31TiHTvkG1TqpPZ0eyA8zlJgWDgQ1Y4UudhVnxlIpmir8fEolbd1IR9P777kIxNtNGkwQxVlIHyNMjGJC34A1Z1juzVJx1D5ZrNzRanvOb0pRYxCKEEsRGPmuJwmfFVA==',key_name='tempest-keypair-1775299019',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='394c4d7e8a6f4b7e8fbefeb88f1f4022',ramdisk_id='',reservation_id='r-lkwtjldh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-9126716',owner_user_name='tempest-TaggedAttachmentsTest-9126716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:44:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5da5f5d0548e4d11b82042832880176d',uuid=d0e9b114-f17b-4b1e-b8e1-b1a821f38974,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e58dc647-6432-4d80-82f6-4917696714ba", "address": "fa:16:3e:54:f0:58", "network": {"id": "778b960f-1779-4399-aec5-b9ce77e8af12", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127978990-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "394c4d7e8a6f4b7e8fbefeb88f1f4022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape58dc647-64", "ovs_interfaceid": "e58dc647-6432-4d80-82f6-4917696714ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:44:36.819628 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Converting VIF {"id": "e58dc647-6432-4d80-82f6-4917696714ba", "address": "fa:16:3e:54:f0:58", "network": {"id": "778b960f-1779-4399-aec5-b9ce77e8af12", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127978990-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "394c4d7e8a6f4b7e8fbefeb88f1f4022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape58dc647-64", "ovs_interfaceid": "e58dc647-6432-4d80-82f6-4917696714ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:36.820242 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:f0:58,bridge_name='br-int',has_traffic_filtering=True,id=e58dc647-6432-4d80-82f6-4917696714ba,network=Network(778b960f-1779-4399-aec5-b9ce77e8af12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape58dc647-64') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:36.821394 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lazy-loading 'pci_devices' on Instance uuid d0e9b114-f17b-4b1e-b8e1-b1a821f38974 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:44:36.829532 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.80', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003587', 'execute': None}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:44:36.842937 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.scaleio [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98952) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 25 04:44:36.874888 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): nvme version {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:36.916405 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] 'nvme version' failed. Not Retrying. {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 04:44:36.916762 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] nvme not present on system {{(pid=98952) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 25 04:44:36.928442 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98952) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 25 04:44:36.930791 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.lightos [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Current host hostNQN and IP(s) are ['10.4.3.80', 'fe80::f816:3eff:feea:dfe4', '192.168.40.6', 'fe80::f816:3eff:fe4f:7c42', '192.168.50.6', 'fe80::f816:3eff:fe6c:e6a6', '192.168.10.6', 'fe80::f816:3eff:fe17:d749', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::b035:28ff:fe70:6f4a', 'fe80::fc16:3eff:fe78:7ac8', 'fe80::1038:1dff:fe1c:d44b', 'fe80::fc16:3eff:fe3a:4858', 'fe80::fc16:3eff:fe4f:4083', 'fe80::fc16:3eff:fecc:30bf', 'fe80::fc16:3eff:feaa:4f74', 'fe80::d0a9:65ff:fe25:9a79', 'fe80::fc16:3eff:fe42:3aef', 'fe80::fc16:3eff:fee8:baea', 'fe80::fc16:3eff:fea7:57df', 'fe80::fc16:3eff:fefa:997d', 'fe80::f404:33ff:febc:fb62', 'fe80::fc16:3eff:fe95:908b', 'fe80::ac3e:37ff:fede:535d', 'fe80::fc16:3eff:fecd:9b6f', 'fe80::7cf5:c7ff:fe12:d4dc', 'fe80::fc16:3eff:fe55:5b09', 'fe80::fc16:3eff:fe48:68a7', 'fe80::fc16:3eff:fe01:4b19', 'fe80::c096:18ff:fe44:3261'] Jun 25 04:44:36.930961 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 25 04:44:36.931135 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] LIGHTOS: no hostnqn found. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 25 04:44:36.931469 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.80', 'host': 'np0000003587', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c81886224652', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a1feb13-40e2-4ac6-989e-b08a6fc0f283', 'nvme_native_multipath': False} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:44:37.183937 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Successfully updated port: a07a18ad-0e1f-46f0-94e5-0c2a44be555a {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:44:37.251384 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-4f47229f-182c-4459-9613-f4b61c26d9a9 req-b3bb44ba-11ec-4c58-acfa-e396be358809 service nova] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Received event network-changed-a07a18ad-0e1f-46f0-94e5-0c2a44be555a {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:37.251645 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-4f47229f-182c-4459-9613-f4b61c26d9a9 req-b3bb44ba-11ec-4c58-acfa-e396be358809 service nova] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Refreshing instance network info cache due to event network-changed-a07a18ad-0e1f-46f0-94e5-0c2a44be555a. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:44:37.252731 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4f47229f-182c-4459-9613-f4b61c26d9a9 req-b3bb44ba-11ec-4c58-acfa-e396be358809 service nova] Acquiring lock "refresh_cache-2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:44:37.252901 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4f47229f-182c-4459-9613-f4b61c26d9a9 req-b3bb44ba-11ec-4c58-acfa-e396be358809 service nova] Acquired lock "refresh_cache-2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:44:37.253077 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-4f47229f-182c-4459-9613-f4b61c26d9a9 req-b3bb44ba-11ec-4c58-acfa-e396be358809 service nova] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Refreshing network info cache for port a07a18ad-0e1f-46f0-94e5-0c2a44be555a {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:44:37.263492 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-f3be368e-5548-44c7-908c-81161ae46516 req-35e0fc67-1167-495e-9de1-b17f8dc5a4da service nova] Releasing lock "refresh_cache-d50f4386-5be2-4ba5-b63f-8cca28d53bbd" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:44:37.267158 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005086359999495471 future=) submitted to {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:37.267274 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:37.267418 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=7.706008460000021 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:37.267466 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=7.705918463000216 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:37.268471 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Emitting event Stopped> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:44:37.268696 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] VM Stopped (Lifecycle Event) Jun 25 04:44:37.307317 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-aa930782-9646-4e44-8a10-8519d81ff9c3 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.075s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] End _get_guest_xml xml= Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: d0e9b114-f17b-4b1e-b8e1-b1a821f38974 Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: instance-00000015 Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: 196608 Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: 1 Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: tempest-device-tagging-server-715977744 Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: 2026-06-25 04:44:36 Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: 192 Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: 1 Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: 0 Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: 0 Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: 1 Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: True Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: bare Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: 1 Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: 0 Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: virtio Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: tempest-TaggedAttachmentsTest-9126716-project-member Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: tempest-TaggedAttachmentsTest-9126716 Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: d0e9b114-f17b-4b1e-b8e1-b1a821f38974 Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: d0e9b114-f17b-4b1e-b8e1-b1a821f38974 Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: hvm Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: 128 Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: 1 Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: Jun 25 04:44:37.325172 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:44:37.327419 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Preparing to wait for external event network-vif-plugged-e58dc647-6432-4d80-82f6-4917696714ba {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:44:37.327419 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Acquiring lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:37.327419 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:37.327419 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:37.327419 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:44:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-715977744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-715977744',id=21,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ31TiHTvkG1TqpPZ0eyA8zlJgWDgQ1Y4UudhVnxlIpmir8fEolbd1IR9P777kIxNtNGkwQxVlIHyNMjGJC34A1Z1juzVJx1D5ZrNzRanvOb0pRYxCKEEsRGPmuJwmfFVA==',key_name='tempest-keypair-1775299019',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='394c4d7e8a6f4b7e8fbefeb88f1f4022',ramdisk_id='',reservation_id='r-lkwtjldh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-9126716',owner_user_name='tempest-TaggedAttachmentsTest-9126716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:44:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5da5f5d0548e4d11b82042832880176d',uuid=d0e9b114-f17b-4b1e-b8e1-b1a821f38974,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e58dc647-6432-4d80-82f6-4917696714ba", "address": "fa:16:3e:54:f0:58", "network": {"id": "778b960f-1779-4399-aec5-b9ce77e8af12", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127978990-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "394c4d7e8a6f4b7e8fbefeb88f1f4022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape58dc647-64", "ovs_interfaceid": "e58dc647-6432-4d80-82f6-4917696714ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:44:37.327419 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Converting VIF {"id": "e58dc647-6432-4d80-82f6-4917696714ba", "address": "fa:16:3e:54:f0:58", "network": {"id": "778b960f-1779-4399-aec5-b9ce77e8af12", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127978990-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "394c4d7e8a6f4b7e8fbefeb88f1f4022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape58dc647-64", "ovs_interfaceid": "e58dc647-6432-4d80-82f6-4917696714ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:37.329074 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:f0:58,bridge_name='br-int',has_traffic_filtering=True,id=e58dc647-6432-4d80-82f6-4917696714ba,network=Network(778b960f-1779-4399-aec5-b9ce77e8af12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape58dc647-64') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:37.329074 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:f0:58,bridge_name='br-int',has_traffic_filtering=True,id=e58dc647-6432-4d80-82f6-4917696714ba,network=Network(778b960f-1779-4399-aec5-b9ce77e8af12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape58dc647-64') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:44:37.331495 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:37.331909 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:37.332202 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:44:37.335975 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:37.336317 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9ce97a7-ff82-5b85-b150-5e963a8e29c6', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:37.337868 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:37.338642 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:37.339821 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:37.342092 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:37.342314 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape58dc647-64, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:37.342746 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape58dc647-64, col_values=(('qos', UUID('bb503d9e-5652-4a26-b162-9bd1b77155fa')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:37.342980 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape58dc647-64, col_values=(('external_ids', {'iface-id': 'e58dc647-6432-4d80-82f6-4917696714ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:f0:58', 'vm-uuid': 'd0e9b114-f17b-4b1e-b8e1-b1a821f38974'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:37.344157 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:37.349159 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:37.352329 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:37.353579 np0000003587 nova-compute[98952]: INFO os_vif [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:f0:58,bridge_name='br-int',has_traffic_filtering=True,id=e58dc647-6432-4d80-82f6-4917696714ba,network=Network(778b960f-1779-4399-aec5-b9ce77e8af12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape58dc647-64') Jun 25 04:44:37.391985 np0000003587 nova-compute[98952]: INFO nova.scheduler.client.report [None req-aa930782-9646-4e44-8a10-8519d81ff9c3 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Deleted allocations for instance 11145d6a-7a4f-4b00-8543-d9b51514d9de Jun 25 04:44:37.534708 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Start spawning the instance on the hypervisor. {{(pid=98952) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 25 04:44:37.542396 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Creating instance directory {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 25 04:44:37.542396 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Creating image(s) Jun 25 04:44:37.542990 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Acquiring lock "/opt/stack/data/nova/instances/2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:37.543183 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Lock "/opt/stack/data/nova/instances/2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:37.543742 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Lock "/opt/stack/data/nova/instances/2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:37.544393 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:44:37.552627 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:44:37.555887 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:37.579349 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2311687b-c5d6-4bcf-8735-96d7e059e3b6 req-eb32c7c2-7f73-4c71-94c8-e6d4ba299f1b service nova] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Received event network-changed-e964866c-f84b-40f3-9766-be7d03de0ccf {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:37.580004 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2311687b-c5d6-4bcf-8735-96d7e059e3b6 req-eb32c7c2-7f73-4c71-94c8-e6d4ba299f1b service nova] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Refreshing instance network info cache due to event network-changed-e964866c-f84b-40f3-9766-be7d03de0ccf. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:44:37.580315 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2311687b-c5d6-4bcf-8735-96d7e059e3b6 req-eb32c7c2-7f73-4c71-94c8-e6d4ba299f1b service nova] Acquiring lock "refresh_cache-57cfae71-795b-408e-850f-5293a22274c3" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:44:37.581140 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2311687b-c5d6-4bcf-8735-96d7e059e3b6 req-eb32c7c2-7f73-4c71-94c8-e6d4ba299f1b service nova] Acquired lock "refresh_cache-57cfae71-795b-408e-850f-5293a22274c3" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:44:37.581395 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-2311687b-c5d6-4bcf-8735-96d7e059e3b6 req-eb32c7c2-7f73-4c71-94c8-e6d4ba299f1b service nova] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Refreshing network info cache for port e964866c-f84b-40f3-9766-be7d03de0ccf {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:44:37.653303 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.098s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:37.654014 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Acquiring lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:37.654588 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:37.655174 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:44:37.659752 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:44:37.660757 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:37.689600 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Acquiring lock "refresh_cache-2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:44:37.694414 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "57cfae71-795b-408e-850f-5293a22274c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.532s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:37.756442 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-4f47229f-182c-4459-9613-f4b61c26d9a9 req-b3bb44ba-11ec-4c58-acfa-e396be358809 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:37.772654 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.112s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:37.775737 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2/disk 1073741824 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:37.775737 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 9aa3370c-9525-460d-b6fc-40a6461bd725] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:44:37.843405 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2/disk 1073741824" returned: 0 in 0.070s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:37.844305 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.189s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:37.844549 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:37.906175 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-4f47229f-182c-4459-9613-f4b61c26d9a9 req-b3bb44ba-11ec-4c58-acfa-e396be358809 service nova] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:44:37.971041 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.125s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:37.971041 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2/disk. size=1073741824 {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 25 04:44:37.971041 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:38.079616 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:38.080393 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Cannot resize image /opt/stack/data/nova/instances/2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2/disk to a smaller size. {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 25 04:44:38.080978 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Created local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 25 04:44:38.081211 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Ensure instance console log exists: /opt/stack/data/nova/instances/2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:44:38.081565 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:38.081974 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:38.082537 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:38.086991 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-2311687b-c5d6-4bcf-8735-96d7e059e3b6 req-eb32c7c2-7f73-4c71-94c8-e6d4ba299f1b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:38.104035 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Starting finish_migration {{(pid=98952) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12808}} Jun 25 04:44:38.108428 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Instance directory exists: not creating {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}} Jun 25 04:44:38.108859 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Creating image(s) Jun 25 04:44:38.109477 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:38.186351 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-4f47229f-182c-4459-9613-f4b61c26d9a9 req-b3bb44ba-11ec-4c58-acfa-e396be358809 service nova] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:44:38.221404 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.112s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:38.222226 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk. size=1073741824 {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 25 04:44:38.223544 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:38.345484 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:38.352248 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Cannot resize image /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk to a smaller size. {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 25 04:44:38.406726 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-aa930782-9646-4e44-8a10-8519d81ff9c3 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Lock "11145d6a-7a4f-4b00-8543-d9b51514d9de" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.127s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:38.609620 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-2311687b-c5d6-4bcf-8735-96d7e059e3b6 req-eb32c7c2-7f73-4c71-94c8-e6d4ba299f1b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:38.690856 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-4f47229f-182c-4459-9613-f4b61c26d9a9 req-b3bb44ba-11ec-4c58-acfa-e396be358809 service nova] Releasing lock "refresh_cache-2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:44:38.691189 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Acquired lock "refresh_cache-2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:44:38.691477 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:44:38.796688 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "57cfae71-795b-408e-850f-5293a22274c3" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:38.797029 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "57cfae71-795b-408e-850f-5293a22274c3" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:38.797418 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Attaching volume 7064d58c-6be7-41d3-ac76-aa6eeef1b479 to /dev/vdb Jun 25 04:44:38.812379 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-2311687b-c5d6-4bcf-8735-96d7e059e3b6 req-eb32c7c2-7f73-4c71-94c8-e6d4ba299f1b service nova] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Updated VIF entry in instance network info cache for port e964866c-f84b-40f3-9766-be7d03de0ccf. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:44:38.813090 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-2311687b-c5d6-4bcf-8735-96d7e059e3b6 req-eb32c7c2-7f73-4c71-94c8-e6d4ba299f1b service nova] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Updating instance_info_cache with network_info: [{"id": "e964866c-f84b-40f3-9766-be7d03de0ccf", "address": "fa:16:3e:cd:9b:6f", "network": {"id": "e6f86cfa-e1c1-4b5f-a202-4fc020faa25c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-929667271-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3904801097947c79fdb5c25d592ac04", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape964866c-f8", "ovs_interfaceid": "e964866c-f84b-40f3-9766-be7d03de0ccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:44:38.859816 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Did not create local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 25 04:44:38.860063 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Ensure instance console log exists: /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:44:38.861134 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:38.861327 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:38.861504 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:38.865251 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Start _get_guest_xml network_info=[{"id": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "address": "fa:16:3e:57:c0:7f", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "vif_mac": "fa:16:3e:57:c0:7f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa68140e2-5c", "ovs_interfaceid": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '4ecaf199-c1b9-4ce3-869c-178c170c1662'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'ea0f9737-865a-4199-9077-b64e88af15db', 'attached_at': '2026-06-25T04:44:37.000000', 'detached_at': '', 'volume_id': '89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'multiattach': True, 'serial': '89748225-9d41-4fb1-b47a-f0f88aa6ebfa'}, 'attachment_id': '271bb3ef-d9e8-4cdd-9d82-653f68fceb36', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:44:38.866686 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.80', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003587', 'execute': None}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:44:38.868859 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:44:38.870981 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='ea0f9737-865a-4199-9077-b64e88af15db'), owner=OwnerMeta(userid='947bde0e827c45f5bab008d094816d8c', username='tempest-AttachVolumeMultiAttachTest-1256899935-project-member', projectid='284d191aa82f453cabcfd18172f74099', projectname='tempest-AttachVolumeMultiAttachTest-1256899935'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "address": "fa:16:3e:57:c0:7f", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "vif_mac": "fa:16:3e:57:c0:7f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa68140e2-5c", "ovs_interfaceid": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362678.870092) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:44:38.872885 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:44:38.873421 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:44:38.874409 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:44:38.874754 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:44:38.875959 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:44:38.876490 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:44:38.876700 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:44:38.876829 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:44:38.876989 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:44:38.877098 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:44:38.877227 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:44:38.877442 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:44:38.877542 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:44:38.877723 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:44:38.877887 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:44:38.878133 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:44:38.905342 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.scaleio [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98952) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 25 04:44:38.908630 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:38.908982 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:38.908982 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] No VIF found with MAC fa:16:3e:54:f0:58, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:44:38.910153 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Using config drive Jun 25 04:44:38.911210 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk.config --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:38.955364 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Running cmd (subprocess): nvme version {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:38.993859 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] 'nvme version' failed. Not Retrying. {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 04:44:38.994727 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] nvme not present on system {{(pid=98952) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 25 04:44:39.004630 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98952) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 25 04:44:39.006645 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.lightos [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Current host hostNQN and IP(s) are ['10.4.3.80', 'fe80::f816:3eff:feea:dfe4', '192.168.40.6', 'fe80::f816:3eff:fe4f:7c42', '192.168.50.6', 'fe80::f816:3eff:fe6c:e6a6', '192.168.10.6', 'fe80::f816:3eff:fe17:d749', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::b035:28ff:fe70:6f4a', 'fe80::fc16:3eff:fe78:7ac8', 'fe80::1038:1dff:fe1c:d44b', 'fe80::fc16:3eff:fe3a:4858', 'fe80::fc16:3eff:fe4f:4083', 'fe80::fc16:3eff:fecc:30bf', 'fe80::fc16:3eff:feaa:4f74', 'fe80::d0a9:65ff:fe25:9a79', 'fe80::fc16:3eff:fe42:3aef', 'fe80::fc16:3eff:fee8:baea', 'fe80::fc16:3eff:fea7:57df', 'fe80::fc16:3eff:fefa:997d', 'fe80::f404:33ff:febc:fb62', 'fe80::fc16:3eff:fe95:908b', 'fe80::ac3e:37ff:fede:535d', 'fe80::fc16:3eff:fecd:9b6f', 'fe80::7cf5:c7ff:fe12:d4dc', 'fe80::fc16:3eff:fe55:5b09', 'fe80::fc16:3eff:fe48:68a7', 'fe80::fc16:3eff:fe01:4b19', 'fe80::c096:18ff:fe44:3261'] Jun 25 04:44:39.006921 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 25 04:44:39.007122 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] LIGHTOS: no hostnqn found. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 25 04:44:39.007824 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.80', 'host': 'np0000003587', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c81886224652', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a1feb13-40e2-4ac6-989e-b08a6fc0f283', 'nvme_native_multipath': False} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:44:39.008089 np0000003587 nova-compute[98952]: DEBUG nova.virt.block_device [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Updating existing volume attachment record: 4056fcc4-3ca2-4033-8f67-d58841c503af {{(pid=98952) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 25 04:44:39.015840 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk.config --force-share --output=json" returned: 0 in 0.105s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:39.016521 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:39.016936 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "/opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:39.018845 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "/opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:39.019369 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Calling os-brick to attach iSCSI Volume {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 25 04:44:39.020914 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:44:39.021935 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:39.022505 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:39.023023 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 25 04:44:39.037584 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:39.038363 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:39.039044 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:39.039304 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:44:39.042574 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:39.042574 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.startup = automatic Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.scan = manual Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.40.100 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:44:39.054059 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.startup = automatic Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.scan = manual Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.50.100 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:44:39.064231 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:39.075298 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:39.084945 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:39.106042 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:39.106042 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:39.106042 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:39.106042 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:39.106042 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:39.106042 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:39.106042 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:39.106042 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:39.106042 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:39.106042 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:39.106042 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:39.106042 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:39.106042 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:39.106335 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsi session list stdout=tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:39.106335 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:39.106335 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:39.106335 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:39.106335 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:39.106335 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:39.106335 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:39.106335 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:39.106335 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:39.106335 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:39.106335 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:39.106335 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:39.106335 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:39.106751 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.068s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:39.106751 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to 192.168.40.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:44:39.108041 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] HCTL ('28', '0', '0', 0) found on session 34 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:44:39.108221 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Scanning host 28 c: 0, t: 0, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsi session list stdout=tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:39.119545 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.080s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:39.120420 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to 192.168.50.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:44:39.123968 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] HCTL ('27', '0', '0', 0) found on session 33 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:44:39.123968 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Scanning host 27 c: 0, t: 0, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:44:39.124999 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching for a device in session 34 and hctl ('28', '0', '0', 0) yield: sdw {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:44:39.124999 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to sdw using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:44:39.132729 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching for a device in session 33 and hctl ('27', '0', '0', 0) yield: sdv {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:44:39.132729 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to sdv using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:44:39.291084 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:44:39.317353 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2311687b-c5d6-4bcf-8735-96d7e059e3b6 req-eb32c7c2-7f73-4c71-94c8-e6d4ba299f1b service nova] Releasing lock "refresh_cache-57cfae71-795b-408e-850f-5293a22274c3" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:44:39.441937 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:39.519998 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:39.582481 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Calling os-brick to attach iSCSI Volume {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 25 04:44:39.582481 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7064d58c-6be7-41d3-ac76-aa6eeef1b479', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:44:39.582899 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:39.636096 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Creating config drive at /opt/stack/data/nova/instances/d0e9b114-f17b-4b1e-b8e1-b1a821f38974/disk.config Jun 25 04:44:39.643188 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d0e9b114-f17b-4b1e-b8e1-b1a821f38974/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe_6pkac_ {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:39.689680 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d0e9b114-f17b-4b1e-b8e1-b1a821f38974/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe_6pkac_" returned: 0 in 0.047s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:39.750356 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Updating instance_info_cache with network_info: [{"id": "a07a18ad-0e1f-46f0-94e5-0c2a44be555a", "address": "fa:16:3e:5a:f2:4b", "network": {"id": "413a8e26-e4c1-4fb0-a9b6-bf506b34bcaa", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-326439259-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50a7f42248fa403e902a08ac254c3de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07a18ad-0e", "ovs_interfaceid": "a07a18ad-0e1f-46f0-94e5-0c2a44be555a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:44:39.978334 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:40.039923 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 25 04:44:40.236072 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:40.256193 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Releasing lock "refresh_cache-2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:44:40.256193 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Instance network_info: |[{"id": "a07a18ad-0e1f-46f0-94e5-0c2a44be555a", "address": "fa:16:3e:5a:f2:4b", "network": {"id": "413a8e26-e4c1-4fb0-a9b6-bf506b34bcaa", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-326439259-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50a7f42248fa403e902a08ac254c3de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07a18ad-0e", "ovs_interfaceid": "a07a18ad-0e1f-46f0-94e5-0c2a44be555a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 25 04:44:40.257658 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Start _get_guest_xml network_info=[{"id": "a07a18ad-0e1f-46f0-94e5-0c2a44be555a", "address": "fa:16:3e:5a:f2:4b", "network": {"id": "413a8e26-e4c1-4fb0-a9b6-bf506b34bcaa", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-326439259-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50a7f42248fa403e902a08ac254c3de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07a18ad-0e", "ovs_interfaceid": "a07a18ad-0e1f-46f0-94e5-0c2a44be555a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '4ecaf199-c1b9-4ce3-869c-178c170c1662'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:44:40.273244 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:40.275059 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:44:40.278988 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-1624184386', uuid='2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2'), owner=OwnerMeta(userid='d20284b14aaf4cb6a60843b0810d782a', username='tempest-VolumesBackupsTest-84947449-project-member', projectid='50a7f42248fa403e902a08ac254c3de7', projectname='tempest-VolumesBackupsTest-84947449'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a07a18ad-0e1f-46f0-94e5-0c2a44be555a", "address": "fa:16:3e:5a:f2:4b", "network": {"id": "413a8e26-e4c1-4fb0-a9b6-bf506b34bcaa", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-326439259-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50a7f42248fa403e902a08ac254c3de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07a18ad-0e", "ovs_interfaceid": "a07a18ad-0e1f-46f0-94e5-0c2a44be555a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362680.2762249) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:44:40.282105 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:44:40.283379 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:44:40.285908 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:44:40.285908 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:44:40.288916 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:44:40.288916 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:44:40.290818 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:44:40.290818 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:44:40.290818 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:44:40.290818 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:44:40.290818 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:44:40.290818 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:44:40.290818 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:44:40.290818 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:44:40.290818 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:44:40.290818 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:44:40.308236 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:44:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1624184386',display_name='tempest-VolumesBackupsTest-instance-1624184386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-volumesbackupstest-instance-1624184386',id=22,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8Mzg336mAprE2qah0fbTweEBAy5OWz98Hrw3vWYuFI5C9gywpvNpiglg8WEKc3gPy/bYt7mSYrqfkoAmfo1VWr1eSvWnONyV7AXTfB0wGJIA1NY4Yb8lYn16kfF8XaiQ==',key_name='tempest-keypair-1932516355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50a7f42248fa403e902a08ac254c3de7',ramdisk_id='',reservation_id='r-kvw90ass',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-84947449',owner_user_name='tempest-VolumesBackupsTest-84947449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:44:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d20284b14aaf4cb6a60843b0810d782a',uuid=2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a07a18ad-0e1f-46f0-94e5-0c2a44be555a", "address": "fa:16:3e:5a:f2:4b", "network": {"id": "413a8e26-e4c1-4fb0-a9b6-bf506b34bcaa", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-326439259-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50a7f42248fa403e902a08ac254c3de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07a18ad-0e", "ovs_interfaceid": "a07a18ad-0e1f-46f0-94e5-0c2a44be555a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:44:40.308613 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Converting VIF {"id": "a07a18ad-0e1f-46f0-94e5-0c2a44be555a", "address": "fa:16:3e:5a:f2:4b", "network": {"id": "413a8e26-e4c1-4fb0-a9b6-bf506b34bcaa", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-326439259-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50a7f42248fa403e902a08ac254c3de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07a18ad-0e", "ovs_interfaceid": "a07a18ad-0e1f-46f0-94e5-0c2a44be555a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:40.310882 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:f2:4b,bridge_name='br-int',has_traffic_filtering=True,id=a07a18ad-0e1f-46f0-94e5-0c2a44be555a,network=Network(413a8e26-e4c1-4fb0-a9b6-bf506b34bcaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07a18ad-0e') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:40.310882 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Lazy-loading 'pci_devices' on Instance uuid 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:44:40.405228 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:40.555351 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:40.652955 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1646b7c8-35df-403d-a328-011f48cbd101 req-0832f5f4-422e-4e1c-a249-04c7241edd6b service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Received event network-vif-plugged-e58dc647-6432-4d80-82f6-4917696714ba {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:40.653436 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1646b7c8-35df-403d-a328-011f48cbd101 req-0832f5f4-422e-4e1c-a249-04c7241edd6b service nova] Acquiring lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:40.653879 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1646b7c8-35df-403d-a328-011f48cbd101 req-0832f5f4-422e-4e1c-a249-04c7241edd6b service nova] Lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:40.654005 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1646b7c8-35df-403d-a328-011f48cbd101 req-0832f5f4-422e-4e1c-a249-04c7241edd6b service nova] Lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:40.654190 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1646b7c8-35df-403d-a328-011f48cbd101 req-0832f5f4-422e-4e1c-a249-04c7241edd6b service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Processing event network-vif-plugged-e58dc647-6432-4d80-82f6-4917696714ba {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:44:40.681209 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:40.683360 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:40.688355 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:40.690378 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:40.719621 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] End _get_guest_xml xml= Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2 Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: instance-00000016 Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: 196608 Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: 1 Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: tempest-VolumesBackupsTest-instance-1624184386 Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: 2026-06-25 04:44:40 Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: 192 Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: 1 Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: 0 Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: 0 Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: 1 Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: True Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: bare Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: 1 Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: 0 Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: virtio Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: tempest-VolumesBackupsTest-84947449-project-member Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: tempest-VolumesBackupsTest-84947449 Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2 Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2 Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: hvm Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: 128 Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: 1 Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: Jun 25 04:44:40.819302 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:44:40.822983 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Preparing to wait for external event network-vif-plugged-a07a18ad-0e1f-46f0-94e5-0c2a44be555a {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:44:40.822983 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Acquiring lock "2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:40.822983 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Lock "2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:40.822983 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Lock "2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:40.822983 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:44:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1624184386',display_name='tempest-VolumesBackupsTest-instance-1624184386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-volumesbackupstest-instance-1624184386',id=22,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8Mzg336mAprE2qah0fbTweEBAy5OWz98Hrw3vWYuFI5C9gywpvNpiglg8WEKc3gPy/bYt7mSYrqfkoAmfo1VWr1eSvWnONyV7AXTfB0wGJIA1NY4Yb8lYn16kfF8XaiQ==',key_name='tempest-keypair-1932516355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50a7f42248fa403e902a08ac254c3de7',ramdisk_id='',reservation_id='r-kvw90ass',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-84947449',owner_user_name='tempest-VolumesBackupsTest-84947449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:44:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d20284b14aaf4cb6a60843b0810d782a',uuid=2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a07a18ad-0e1f-46f0-94e5-0c2a44be555a", "address": "fa:16:3e:5a:f2:4b", "network": {"id": "413a8e26-e4c1-4fb0-a9b6-bf506b34bcaa", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-326439259-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50a7f42248fa403e902a08ac254c3de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07a18ad-0e", "ovs_interfaceid": "a07a18ad-0e1f-46f0-94e5-0c2a44be555a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:44:40.822983 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Converting VIF {"id": "a07a18ad-0e1f-46f0-94e5-0c2a44be555a", "address": "fa:16:3e:5a:f2:4b", "network": {"id": "413a8e26-e4c1-4fb0-a9b6-bf506b34bcaa", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-326439259-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50a7f42248fa403e902a08ac254c3de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07a18ad-0e", "ovs_interfaceid": "a07a18ad-0e1f-46f0-94e5-0c2a44be555a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:40.822983 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:f2:4b,bridge_name='br-int',has_traffic_filtering=True,id=a07a18ad-0e1f-46f0-94e5-0c2a44be555a,network=Network(413a8e26-e4c1-4fb0-a9b6-bf506b34bcaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07a18ad-0e') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:40.822983 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:f2:4b,bridge_name='br-int',has_traffic_filtering=True,id=a07a18ad-0e1f-46f0-94e5-0c2a44be555a,network=Network(413a8e26-e4c1-4fb0-a9b6-bf506b34bcaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07a18ad-0e') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:44:40.822983 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:40.823747 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:40.824000 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:44:40.825491 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:40.825897 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6127142b-ec1d-5a9d-a315-5fef0fda44ae', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:40.828435 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:40.833027 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:40.833318 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa07a18ad-0e, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:40.833631 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa07a18ad-0e, col_values=(('qos', UUID('38636890-9457-4e73-86b5-a35dd8c7254e')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:40.833815 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa07a18ad-0e, col_values=(('external_ids', {'iface-id': 'a07a18ad-0e1f-46f0-94e5-0c2a44be555a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:f2:4b', 'vm-uuid': '2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:40.836702 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:40.843241 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:40.844234 np0000003587 nova-compute[98952]: INFO os_vif [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:f2:4b,bridge_name='br-int',has_traffic_filtering=True,id=a07a18ad-0e1f-46f0-94e5-0c2a44be555a,network=Network(413a8e26-e4c1-4fb0-a9b6-bf506b34bcaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa07a18ad-0e') Jun 25 04:44:40.890967 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquiring lock "8b915629-823e-4b55-bc64-d73e58b79bdc" by "nova.compute.manager.ComputeManager.reboot_instance..do_reboot_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:40.890967 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc" acquired by "nova.compute.manager.ComputeManager.reboot_instance..do_reboot_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:40.890967 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Rebooting instance Jun 25 04:44:40.950003 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:40.950376 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:40.950610 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:40.950826 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:40.951006 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:40.954691 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Terminating instance Jun 25 04:44:41.007348 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:41.062501 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Found WWN 330000000a5c943c3 for multipath device dm-18 {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 25 04:44:41.063078 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.040s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:41.064227 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] <== connect_volume: return (2042ms) {'type': 'block', 'scsi_wwn': '330000000a5c943c3', 'path': '/dev/dm-18', 'multipath_id': '330000000a5c943c3'} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:44:41.065209 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a5c943c3', 'path': '/dev/dm-18', 'multipath_id': '330000000a5c943c3'} {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 25 04:44:41.065370 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.481s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:41.065804 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7064d58c-6be7-41d3-ac76-aa6eeef1b479', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 25 04:44:41.080544 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:41.080955 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:41.081374 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:41.082012 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:44:41.082099 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:41.082282 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:44:41.097144 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:44:41.097144 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:41.102874 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:44:41.102874 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:41.110426 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479] added Jun 25 04:44:41.110426 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:44:41.110426 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:44:41.110426 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:44:41.110426 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:44:41.110426 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:44:41.110426 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:41.111097 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:44:41.111771 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0297(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:44:41.111771 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:44:41.115571 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479] added Jun 25 04:44:41.115571 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:44:41.115571 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:44:41.115571 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:44:41.115571 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:44:41.115571 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:44:41.115571 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:41.115940 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:44:41.116089 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0337(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:44:41.116284 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:44:41.404460 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:44:41.405082 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] VM Started (Lifecycle Event) Jun 25 04:44:41.406203 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:44:41.409720 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Guest created on hypervisor {{(pid=98952) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 25 04:44:41.413036 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Instance spawned successfully. Jun 25 04:44:41.414700 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 25 04:44:41.460549 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Start destroying the instance on the hypervisor. {{(pid=98952) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 25 04:44:41.490103 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquiring lock "refresh_cache-8b915629-823e-4b55-bc64-d73e58b79bdc" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:44:41.490177 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquired lock "refresh_cache-8b915629-823e-4b55-bc64-d73e58b79bdc" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:44:41.490320 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:44:41.492903 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:41.498404 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:41.526373 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:41.542233 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:41.564149 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:41.572174 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:43:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000003587',hostname='multiattach-server-0',id=13,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV/p3ZeuUk+pDtRyjEqB6LGacp/8M+rMj60nbQpQu7IIRoy9lFRhD1vsgSIFDZ+PjS4ytFpGVQZ3frW+0uH/J+qnA92sFXepo+od7tCOydqRChW2tpsraqZi+iIk6G08A==',key_name='tempest-keypair-462979399',keypairs=,launch_index=0,launched_at=2026-06-25T04:43:29Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003587',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='284d191aa82f453cabcfd18172f74099',ramdisk_id='',reservation_id='r-z9bdjah6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1256899935',owner_user_name='tempest-AttachVolumeMultiAttachTest-1256899935-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:44:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='947bde0e827c45f5bab008d094816d8c',uuid=ea0f9737-865a-4199-9077-b64e88af15db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "address": "fa:16:3e:57:c0:7f", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "vif_mac": "fa:16:3e:57:c0:7f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa68140e2-5c", "ovs_interfaceid": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:44:41.572585 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converting VIF {"id": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "address": "fa:16:3e:57:c0:7f", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "vif_mac": "fa:16:3e:57:c0:7f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa68140e2-5c", "ovs_interfaceid": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:41.573571 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:c0:7f,bridge_name='br-int',has_traffic_filtering=True,id=a68140e2-5c7f-49c9-abbb-fbc11cf20cf2,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa68140e2-5c') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] End _get_guest_xml xml= Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: ea0f9737-865a-4199-9077-b64e88af15db Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: instance-0000000d Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: 262144 Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: 1 Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: multiattach-server-0 Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: 2026-06-25 04:44:38 Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: 256 Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: 1 Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: 0 Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: 0 Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: 1 Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: True Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: bare Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: 1 Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: 0 Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: ide Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: virtio Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: pc Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: virtio Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: virtio Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: virtio Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: tempest-AttachVolumeMultiAttachTest-1256899935-project-member Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: tempest-AttachVolumeMultiAttachTest-1256899935 Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: ea0f9737-865a-4199-9077-b64e88af15db Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: ea0f9737-865a-4199-9077-b64e88af15db Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: hvm Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: 128 Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: 1 Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: 89748225-9d41-4fb1-b47a-f0f88aa6ebfa Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: Jun 25 04:44:41.575762 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:44:41.580042 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:43:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000003587',hostname='multiattach-server-0',id=13,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV/p3ZeuUk+pDtRyjEqB6LGacp/8M+rMj60nbQpQu7IIRoy9lFRhD1vsgSIFDZ+PjS4ytFpGVQZ3frW+0uH/J+qnA92sFXepo+od7tCOydqRChW2tpsraqZi+iIk6G08A==',key_name='tempest-keypair-462979399',keypairs=,launch_index=0,launched_at=2026-06-25T04:43:29Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003587',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='284d191aa82f453cabcfd18172f74099',ramdisk_id='',reservation_id='r-z9bdjah6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1256899935',owner_user_name='tempest-AttachVolumeMultiAttachTest-1256899935-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:44:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='947bde0e827c45f5bab008d094816d8c',uuid=ea0f9737-865a-4199-9077-b64e88af15db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "address": "fa:16:3e:57:c0:7f", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "vif_mac": "fa:16:3e:57:c0:7f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa68140e2-5c", "ovs_interfaceid": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:44:41.580042 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converting VIF {"id": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "address": "fa:16:3e:57:c0:7f", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "vif_mac": "fa:16:3e:57:c0:7f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa68140e2-5c", "ovs_interfaceid": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:41.580042 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:c0:7f,bridge_name='br-int',has_traffic_filtering=True,id=a68140e2-5c7f-49c9-abbb-fbc11cf20cf2,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa68140e2-5c') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:41.580042 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:c0:7f,bridge_name='br-int',has_traffic_filtering=True,id=a68140e2-5c7f-49c9-abbb-fbc11cf20cf2,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa68140e2-5c') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:44:41.580042 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:41.580042 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:41.580519 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:44:41.581851 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:41.582521 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e8c875a-e80f-53a7-a826-62f1db144f6e', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:41.584121 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:41.585105 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:41.611099 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:41.621384 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:41.732116 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:41.753928 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:41.754693 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa68140e2-5c, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:41.755315 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa68140e2-5c, col_values=(('qos', UUID('745bafdb-9477-4b05-888f-002c80db7a8e')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:41.756717 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa68140e2-5c, col_values=(('external_ids', {'iface-id': 'a68140e2-5c7f-49c9-abbb-fbc11cf20cf2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:c0:7f', 'vm-uuid': 'ea0f9737-865a-4199-9077-b64e88af15db'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:41.758582 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:41.759865 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:41.800314 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:41.908528 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:44:41.918648 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:41.920011 np0000003587 nova-compute[98952]: INFO os_vif [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:c0:7f,bridge_name='br-int',has_traffic_filtering=True,id=a68140e2-5c7f-49c9-abbb-fbc11cf20cf2,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa68140e2-5c') Jun 25 04:44:41.922013 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:41.925846 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:44:41.928936 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Found default for hw_cdrom_bus of ide {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:44:41.929114 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Found default for hw_disk_bus of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:44:41.930860 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Found default for hw_input_bus of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:44:41.930860 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Found default for hw_pointer_model of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:44:41.930860 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Found default for hw_video_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:44:41.930860 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Found default for hw_vif_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:44:41.943326 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:41.948259 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-9683d467-25ad-46a8-b3a0-8aed958ed5a2 req-52a54b51-31cb-44b1-9bae-dfe3ba8a3030 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-22fd01da-9056-4cd0-8489-c9f005bb66a5 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:41.949304 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-9683d467-25ad-46a8-b3a0-8aed958ed5a2 req-52a54b51-31cb-44b1-9bae-dfe3ba8a3030 service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:41.949466 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-9683d467-25ad-46a8-b3a0-8aed958ed5a2 req-52a54b51-31cb-44b1-9bae-dfe3ba8a3030 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:41.949628 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-9683d467-25ad-46a8-b3a0-8aed958ed5a2 req-52a54b51-31cb-44b1-9bae-dfe3ba8a3030 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:41.949789 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-9683d467-25ad-46a8-b3a0-8aed958ed5a2 req-52a54b51-31cb-44b1-9bae-dfe3ba8a3030 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] No waiting events found dispatching network-vif-unplugged-22fd01da-9056-4cd0-8489-c9f005bb66a5 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:41.949910 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-9683d467-25ad-46a8-b3a0-8aed958ed5a2 req-52a54b51-31cb-44b1-9bae-dfe3ba8a3030 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-22fd01da-9056-4cd0-8489-c9f005bb66a5 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:41.994909 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:41.994909 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.027684 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.082545 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.113015 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:44:42.118960 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-e134bdc4-e3a5-40e4-95d1-0e60c4c5e7bb req-a09b026e-4850-45d2-9a96-929552a205c0 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-ed1393f8-f25b-489d-9635-82b920d33137 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:42.120712 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-e134bdc4-e3a5-40e4-95d1-0e60c4c5e7bb req-a09b026e-4850-45d2-9a96-929552a205c0 service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:42.121130 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-e134bdc4-e3a5-40e4-95d1-0e60c4c5e7bb req-a09b026e-4850-45d2-9a96-929552a205c0 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:42.121323 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-e134bdc4-e3a5-40e4-95d1-0e60c4c5e7bb req-a09b026e-4850-45d2-9a96-929552a205c0 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:42.121521 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-e134bdc4-e3a5-40e4-95d1-0e60c4c5e7bb req-a09b026e-4850-45d2-9a96-929552a205c0 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] No waiting events found dispatching network-vif-unplugged-ed1393f8-f25b-489d-9635-82b920d33137 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:42.122717 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-e134bdc4-e3a5-40e4-95d1-0e60c4c5e7bb req-a09b026e-4850-45d2-9a96-929552a205c0 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-ed1393f8-f25b-489d-9635-82b920d33137 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:42.126536 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.40.100 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:44:42.139251 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:42.143573 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Instance destroyed successfully. Jun 25 04:44:42.144987 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lazy-loading 'resources' on Instance uuid 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.50.100 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:44:42.150455 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:42.157888 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.163501 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:42.172763 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:42.196204 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:42.196204 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:42.196204 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:42.196204 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:42.196204 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:42.196204 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:42.196204 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:42.196204 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:42.196204 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:42.196204 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:42.196204 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:42.196204 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:42.196204 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:42.196676 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsi session list stdout=tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:42.196676 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:42.196676 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:42.196676 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:42.196676 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:42.196676 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:42.196676 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:42.196676 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:42.196676 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:42.196676 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:42.196676 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:42.196676 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:42.196676 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:42.203693 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:42.203693 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:42.203693 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:42.203693 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:42.203693 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:42.203693 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:42.203693 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:42.203693 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:42.203693 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:42.203693 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:42.203693 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:42.203693 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:42.203693 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:42.204197 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsi session list stdout=tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:42.204197 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:42.204197 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:42.204197 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:42.204197 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:42.204197 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:42.204197 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:42.204197 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:42.204197 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:42.204197 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:42.204197 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:42.204197 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:42.204197 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:42.264170 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.298912 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479, portal: 192.168.50.100,3260] Jun 25 04:44:42.298912 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479, portal: 192.168.50.100,3260] successful. Jun 25 04:44:42.298912 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:42.319138 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.321099 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:42.362397 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:42.362397 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:42.362397 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:42.362397 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:42.362397 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:42.362397 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:42.362397 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:42.362397 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:42.362397 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:42.362397 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:42.362397 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:42.362397 np0000003587 nova-compute[98952]: tcp: [37] 192.168.40.100:3260,0 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:42.362397 np0000003587 nova-compute[98952]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:42.362397 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:42.362397 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:42.363213 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsi session list stdout=tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:42.363213 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:42.363213 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:42.363213 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:42.363213 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:42.363213 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:42.363213 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:42.363213 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:42.363213 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:42.363213 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:42.363213 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:42.363213 np0000003587 nova-compute[98952]: tcp: [37] 192.168.40.100:3260,0 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:42.363213 np0000003587 nova-compute[98952]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:42.363213 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:42.363213 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:42.363213 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.281s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:42.363213 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Connected to 192.168.50.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:44:42.365370 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] HCTL ('10', '-', '-', 0) found on session 38 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:44:42.365370 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:44:42.386108 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.391351 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:42.391351 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:42.391351 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] No VIF found with MAC fa:16:3e:5a:f2:4b, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:44:42.391351 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Using config drive Jun 25 04:44:42.395123 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Searching for a device in session 38 and hctl ['10', '*', '*', 0] yield: sdd {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:44:42.395123 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7064d58c-6be7-41d3-ac76-aa6eeef1b479', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:44:42.437246 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] During sync_power_state the instance has a pending task (spawning). Skip. Jun 25 04:44:42.437785 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Paused> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:44:42.437785 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] VM Paused (Lifecycle Event) Jun 25 04:44:42.445851 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Took 8.41 seconds to spawn the instance on the hypervisor. Jun 25 04:44:42.445851 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:44:42.652372 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495923',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-537495923',id=12,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTa58cRFRWbbTonGFe1bcwC1cM5TfvMm5/ily9Wj5GN+GBKU2guWLZGoTDoxD7RBf8OLyMFDHq2HS1DBYy4i3i4VGt3td4oZT929qL3XO3APtqNhUYeVDjYIUqmMs06wg==',key_name='tempest-keypair-740147084',keypairs=,launch_index=0,launched_at=2026-06-25T04:43:31Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='40a42527a8b24135b741fe2c38dc14b0',ramdisk_id='',reservation_id='r-uvd0ozk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2097804610',owner_user_name='tempest-TaggedBootDevicesTest-2097804610-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:43:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e73054ab2cbd425cb182705f0ebfb7a5',uuid=25ee71dc-21c1-4ed4-b3d4-7f8cc107a863,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22fd01da-9056-4cd0-8489-c9f005bb66a5", "address": "fa:16:3e:cc:30:bf", "network": {"id": "e2c0ccd0-a308-4fd9-8b43-472d9a2acb3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-814024004-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22fd01da-90", "ovs_interfaceid": "22fd01da-9056-4cd0-8489-c9f005bb66a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:44:42.652650 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converting VIF {"id": "22fd01da-9056-4cd0-8489-c9f005bb66a5", "address": "fa:16:3e:cc:30:bf", "network": {"id": "e2c0ccd0-a308-4fd9-8b43-472d9a2acb3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-814024004-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap22fd01da-90", "ovs_interfaceid": "22fd01da-9056-4cd0-8489-c9f005bb66a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:42.653120 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:30:bf,bridge_name='br-int',has_traffic_filtering=True,id=22fd01da-9056-4cd0-8489-c9f005bb66a5,network=Network(e2c0ccd0-a308-4fd9-8b43-472d9a2acb3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22fd01da-90') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:42.653426 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:30:bf,bridge_name='br-int',has_traffic_filtering=True,id=22fd01da-9056-4cd0-8489-c9f005bb66a5,network=Network(e2c0ccd0-a308-4fd9-8b43-472d9a2acb3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22fd01da-90') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:44:42.659357 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.659621 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22fd01da-90, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:42.662709 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.664012 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:42.706086 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.707544 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.707897 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f8bc9812-029f-4b0f-8b11-8eda4727bf4a) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:42.708525 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.709276 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:42.748446 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.752013 np0000003587 nova-compute[98952]: INFO os_vif [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:30:bf,bridge_name='br-int',has_traffic_filtering=True,id=22fd01da-9056-4cd0-8489-c9f005bb66a5,network=Network(e2c0ccd0-a308-4fd9-8b43-472d9a2acb3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22fd01da-90') Jun 25 04:44:42.752222 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495923',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-537495923',id=12,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTa58cRFRWbbTonGFe1bcwC1cM5TfvMm5/ily9Wj5GN+GBKU2guWLZGoTDoxD7RBf8OLyMFDHq2HS1DBYy4i3i4VGt3td4oZT929qL3XO3APtqNhUYeVDjYIUqmMs06wg==',key_name='tempest-keypair-740147084',keypairs=,launch_index=0,launched_at=2026-06-25T04:43:31Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='40a42527a8b24135b741fe2c38dc14b0',ramdisk_id='',reservation_id='r-uvd0ozk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2097804610',owner_user_name='tempest-TaggedBootDevicesTest-2097804610-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:43:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e73054ab2cbd425cb182705f0ebfb7a5',uuid=25ee71dc-21c1-4ed4-b3d4-7f8cc107a863,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a36eb1f7-4779-4078-a224-bc487abd01a6", "address": "fa:16:3e:aa:4f:74", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36eb1f7-47", "ovs_interfaceid": "a36eb1f7-4779-4078-a224-bc487abd01a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:44:42.752672 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converting VIF {"id": "a36eb1f7-4779-4078-a224-bc487abd01a6", "address": "fa:16:3e:aa:4f:74", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36eb1f7-47", "ovs_interfaceid": "a36eb1f7-4779-4078-a224-bc487abd01a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:42.753076 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:4f:74,bridge_name='br-int',has_traffic_filtering=True,id=a36eb1f7-4779-4078-a224-bc487abd01a6,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa36eb1f7-47') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:42.753244 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:4f:74,bridge_name='br-int',has_traffic_filtering=True,id=a36eb1f7-4779-4078-a224-bc487abd01a6,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa36eb1f7-47') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:44:42.753995 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.754153 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa36eb1f7-47, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:42.755351 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.756443 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:42.794089 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.795809 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.796170 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e4e0c9e-20de-4815-8164-03f546694707) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:42.796943 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.798729 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:42.831602 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.833823 np0000003587 nova-compute[98952]: INFO os_vif [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:4f:74,bridge_name='br-int',has_traffic_filtering=True,id=a36eb1f7-4779-4078-a224-bc487abd01a6,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa36eb1f7-47') Jun 25 04:44:42.834771 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495923',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-537495923',id=12,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTa58cRFRWbbTonGFe1bcwC1cM5TfvMm5/ily9Wj5GN+GBKU2guWLZGoTDoxD7RBf8OLyMFDHq2HS1DBYy4i3i4VGt3td4oZT929qL3XO3APtqNhUYeVDjYIUqmMs06wg==',key_name='tempest-keypair-740147084',keypairs=,launch_index=0,launched_at=2026-06-25T04:43:31Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='40a42527a8b24135b741fe2c38dc14b0',ramdisk_id='',reservation_id='r-uvd0ozk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2097804610',owner_user_name='tempest-TaggedBootDevicesTest-2097804610-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:43:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e73054ab2cbd425cb182705f0ebfb7a5',uuid=25ee71dc-21c1-4ed4-b3d4-7f8cc107a863,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff5a5c31-e634-489a-b565-418e87aaa11b", "address": "fa:16:3e:42:3a:ef", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5a5c31-e6", "ovs_interfaceid": "ff5a5c31-e634-489a-b565-418e87aaa11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:44:42.834771 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converting VIF {"id": "ff5a5c31-e634-489a-b565-418e87aaa11b", "address": "fa:16:3e:42:3a:ef", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5a5c31-e6", "ovs_interfaceid": "ff5a5c31-e634-489a-b565-418e87aaa11b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:42.835402 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:3a:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff5a5c31-e634-489a-b565-418e87aaa11b,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff5a5c31-e6') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:42.835663 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:3a:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff5a5c31-e634-489a-b565-418e87aaa11b,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff5a5c31-e6') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:44:42.836838 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.837187 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff5a5c31-e6, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:42.839622 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.840814 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:42.872248 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.873926 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.874209 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=281e3f54-d688-4b1d-a515-770d69c8c6c8) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:42.874977 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.875716 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:42.900397 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:42.904956 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.907385 np0000003587 nova-compute[98952]: INFO os_vif [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:3a:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff5a5c31-e634-489a-b565-418e87aaa11b,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff5a5c31-e6') Jun 25 04:44:42.908401 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495923',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-537495923',id=12,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTa58cRFRWbbTonGFe1bcwC1cM5TfvMm5/ily9Wj5GN+GBKU2guWLZGoTDoxD7RBf8OLyMFDHq2HS1DBYy4i3i4VGt3td4oZT929qL3XO3APtqNhUYeVDjYIUqmMs06wg==',key_name='tempest-keypair-740147084',keypairs=,launch_index=0,launched_at=2026-06-25T04:43:31Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='40a42527a8b24135b741fe2c38dc14b0',ramdisk_id='',reservation_id='r-uvd0ozk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2097804610',owner_user_name='tempest-TaggedBootDevicesTest-2097804610-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:43:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e73054ab2cbd425cb182705f0ebfb7a5',uuid=25ee71dc-21c1-4ed4-b3d4-7f8cc107a863,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7d7f523-bf9e-4f8f-881d-9d05c514eb54", "address": "fa:16:3e:e8:ba:ea", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d7f523-bf", "ovs_interfaceid": "a7d7f523-bf9e-4f8f-881d-9d05c514eb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:44:42.908689 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converting VIF {"id": "a7d7f523-bf9e-4f8f-881d-9d05c514eb54", "address": "fa:16:3e:e8:ba:ea", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d7f523-bf", "ovs_interfaceid": "a7d7f523-bf9e-4f8f-881d-9d05c514eb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:42.909169 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ba:ea,bridge_name='br-int',has_traffic_filtering=True,id=a7d7f523-bf9e-4f8f-881d-9d05c514eb54,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d7f523-bf') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:42.909342 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ba:ea,bridge_name='br-int',has_traffic_filtering=True,id=a7d7f523-bf9e-4f8f-881d-9d05c514eb54,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d7f523-bf') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:44:42.910398 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.910693 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7d7f523-bf, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:42.911946 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.913029 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:42.944366 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:44:42.944987 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.948464 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.948696 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09e9fdd1-fe4d-47db-bcc4-3de998685abe) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:42.949486 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.950031 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:42.951529 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:44:42.951644 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] VM Resumed (Lifecycle Event) Jun 25 04:44:42.963877 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Took 14.48 seconds to build instance. Jun 25 04:44:42.978798 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.983122 np0000003587 nova-compute[98952]: INFO os_vif [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ba:ea,bridge_name='br-int',has_traffic_filtering=True,id=a7d7f523-bf9e-4f8f-881d-9d05c514eb54,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d7f523-bf') Jun 25 04:44:42.987549 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495923',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-537495923',id=12,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTa58cRFRWbbTonGFe1bcwC1cM5TfvMm5/ily9Wj5GN+GBKU2guWLZGoTDoxD7RBf8OLyMFDHq2HS1DBYy4i3i4VGt3td4oZT929qL3XO3APtqNhUYeVDjYIUqmMs06wg==',key_name='tempest-keypair-740147084',keypairs=,launch_index=0,launched_at=2026-06-25T04:43:31Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='40a42527a8b24135b741fe2c38dc14b0',ramdisk_id='',reservation_id='r-uvd0ozk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2097804610',owner_user_name='tempest-TaggedBootDevicesTest-2097804610-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:43:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e73054ab2cbd425cb182705f0ebfb7a5',uuid=25ee71dc-21c1-4ed4-b3d4-7f8cc107a863,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed1393f8-f25b-489d-9635-82b920d33137", "address": "fa:16:3e:a7:57:df", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped1393f8-f2", "ovs_interfaceid": "ed1393f8-f25b-489d-9635-82b920d33137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:44:42.988102 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converting VIF {"id": "ed1393f8-f25b-489d-9635-82b920d33137", "address": "fa:16:3e:a7:57:df", "network": {"id": "ca32332d-7639-4aaf-9d88-5fe48c6d01fd", "bridge": "br-int", "label": "tempest-device-tagging-net1-623545905", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped1393f8-f2", "ovs_interfaceid": "ed1393f8-f25b-489d-9635-82b920d33137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:42.989818 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:57:df,bridge_name='br-int',has_traffic_filtering=True,id=ed1393f8-f25b-489d-9635-82b920d33137,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped1393f8-f2') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:42.989818 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:57:df,bridge_name='br-int',has_traffic_filtering=True,id=ed1393f8-f25b-489d-9635-82b920d33137,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped1393f8-f2') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:44:42.990995 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.990995 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped1393f8-f2, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:42.993451 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:42.995170 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:43.015490 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:43.016752 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:43.017143 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb9de9ce-1d40-4434-9a9c-e58a4c9ac832) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:43.017862 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:43.018779 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:43.043153 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:43.046169 np0000003587 nova-compute[98952]: INFO os_vif [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:57:df,bridge_name='br-int',has_traffic_filtering=True,id=ed1393f8-f25b-489d-9635-82b920d33137,network=Network(ca32332d-7639-4aaf-9d88-5fe48c6d01fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped1393f8-f2') Jun 25 04:44:43.047346 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495923',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-537495923',id=12,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTa58cRFRWbbTonGFe1bcwC1cM5TfvMm5/ily9Wj5GN+GBKU2guWLZGoTDoxD7RBf8OLyMFDHq2HS1DBYy4i3i4VGt3td4oZT929qL3XO3APtqNhUYeVDjYIUqmMs06wg==',key_name='tempest-keypair-740147084',keypairs=,launch_index=0,launched_at=2026-06-25T04:43:31Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='40a42527a8b24135b741fe2c38dc14b0',ramdisk_id='',reservation_id='r-uvd0ozk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2097804610',owner_user_name='tempest-TaggedBootDevicesTest-2097804610-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:43:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e73054ab2cbd425cb182705f0ebfb7a5',uuid=25ee71dc-21c1-4ed4-b3d4-7f8cc107a863,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2af2f66c-7de8-49e4-badd-16d0764caff6", "address": "fa:16:3e:fa:99:7d", "network": {"id": "dbbc0276-7726-40fd-b3ee-f5a7887f5e72", "bridge": "br-int", "label": "tempest-device-tagging-net2-1967790487", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af2f66c-7d", "ovs_interfaceid": "2af2f66c-7de8-49e4-badd-16d0764caff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:44:43.047346 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converting VIF {"id": "2af2f66c-7de8-49e4-badd-16d0764caff6", "address": "fa:16:3e:fa:99:7d", "network": {"id": "dbbc0276-7726-40fd-b3ee-f5a7887f5e72", "bridge": "br-int", "label": "tempest-device-tagging-net2-1967790487", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af2f66c-7d", "ovs_interfaceid": "2af2f66c-7de8-49e4-badd-16d0764caff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:43.047710 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:99:7d,bridge_name='br-int',has_traffic_filtering=True,id=2af2f66c-7de8-49e4-badd-16d0764caff6,network=Network(dbbc0276-7726-40fd-b3ee-f5a7887f5e72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2af2f66c-7d') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:43.047888 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:99:7d,bridge_name='br-int',has_traffic_filtering=True,id=2af2f66c-7de8-49e4-badd-16d0764caff6,network=Network(dbbc0276-7726-40fd-b3ee-f5a7887f5e72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2af2f66c-7d') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:44:43.050207 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:43.050207 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2af2f66c-7d, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:43.050992 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:43.053544 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:43.069308 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:43.070423 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:43.070660 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e815ba74-e17c-401e-b65a-d74d07e6431e) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:43.078458 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:43.078458 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:43.099049 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:43.103017 np0000003587 nova-compute[98952]: INFO os_vif [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:99:7d,bridge_name='br-int',has_traffic_filtering=True,id=2af2f66c-7de8-49e4-badd-16d0764caff6,network=Network(dbbc0276-7726-40fd-b3ee-f5a7887f5e72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2af2f66c-7d') Jun 25 04:44:43.104151 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-537495923',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-537495923',id=12,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTa58cRFRWbbTonGFe1bcwC1cM5TfvMm5/ily9Wj5GN+GBKU2guWLZGoTDoxD7RBf8OLyMFDHq2HS1DBYy4i3i4VGt3td4oZT929qL3XO3APtqNhUYeVDjYIUqmMs06wg==',key_name='tempest-keypair-740147084',keypairs=,launch_index=0,launched_at=2026-06-25T04:43:31Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='40a42527a8b24135b741fe2c38dc14b0',ramdisk_id='',reservation_id='r-uvd0ozk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2097804610',owner_user_name='tempest-TaggedBootDevicesTest-2097804610-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:43:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e73054ab2cbd425cb182705f0ebfb7a5',uuid=25ee71dc-21c1-4ed4-b3d4-7f8cc107a863,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07a46cd4-912b-4863-8b8f-f345fe260bd0", "address": "fa:16:3e:95:90:8b", "network": {"id": "dbbc0276-7726-40fd-b3ee-f5a7887f5e72", "bridge": "br-int", "label": "tempest-device-tagging-net2-1967790487", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a46cd4-91", "ovs_interfaceid": "07a46cd4-912b-4863-8b8f-f345fe260bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:44:43.104509 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converting VIF {"id": "07a46cd4-912b-4863-8b8f-f345fe260bd0", "address": "fa:16:3e:95:90:8b", "network": {"id": "dbbc0276-7726-40fd-b3ee-f5a7887f5e72", "bridge": "br-int", "label": "tempest-device-tagging-net2-1967790487", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a42527a8b24135b741fe2c38dc14b0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07a46cd4-91", "ovs_interfaceid": "07a46cd4-912b-4863-8b8f-f345fe260bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:43.105177 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=07a46cd4-912b-4863-8b8f-f345fe260bd0,network=Network(dbbc0276-7726-40fd-b3ee-f5a7887f5e72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a46cd4-91') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:43.105429 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=07a46cd4-912b-4863-8b8f-f345fe260bd0,network=Network(dbbc0276-7726-40fd-b3ee-f5a7887f5e72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a46cd4-91') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:44:43.106574 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:43.106937 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07a46cd4-91, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:43.112862 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:43.114085 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:43.123139 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:43.125196 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:43.125508 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a3ee89b1-f329-45b8-b66b-58048f174ed7) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:43.126931 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:43.129957 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:43.139685 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:43.142533 np0000003587 nova-compute[98952]: INFO os_vif [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:90:8b,bridge_name='br-int',has_traffic_filtering=True,id=07a46cd4-912b-4863-8b8f-f345fe260bd0,network=Network(dbbc0276-7726-40fd-b3ee-f5a7887f5e72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07a46cd4-91') Jun 25 04:44:43.146467 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] calling os-brick to detach iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 25 04:44:43.146836 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '94315545-1fac-434f-9971-01dd561f2296', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:44:43.146987 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:43.176482 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Creating config drive at /opt/stack/data/nova/instances/2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2/disk.config Jun 25 04:44:43.180628 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpx9azuxcc {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:43.237429 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpx9azuxcc" returned: 0 in 0.056s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:43.295791 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479, portal: 192.168.40.100,3260] Jun 25 04:44:43.295791 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479, portal: 192.168.40.100,3260] successful. Jun 25 04:44:43.295791 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:43.300919 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:43.311245 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:43.328899 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-530fcf16-9069-4b07-bef4-1ac424c218bd req-d424e392-e811-4cf5-a1a9-db9cc36ab3e1 service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Received event network-vif-plugged-e58dc647-6432-4d80-82f6-4917696714ba {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:43.329281 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-530fcf16-9069-4b07-bef4-1ac424c218bd req-d424e392-e811-4cf5-a1a9-db9cc36ab3e1 service nova] Acquiring lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:43.329616 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-530fcf16-9069-4b07-bef4-1ac424c218bd req-d424e392-e811-4cf5-a1a9-db9cc36ab3e1 service nova] Lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:43.329867 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-530fcf16-9069-4b07-bef4-1ac424c218bd req-d424e392-e811-4cf5-a1a9-db9cc36ab3e1 service nova] Lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:43.330435 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-530fcf16-9069-4b07-bef4-1ac424c218bd req-d424e392-e811-4cf5-a1a9-db9cc36ab3e1 service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] No waiting events found dispatching network-vif-plugged-e58dc647-6432-4d80-82f6-4917696714ba {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:43.330707 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-530fcf16-9069-4b07-bef4-1ac424c218bd req-d424e392-e811-4cf5-a1a9-db9cc36ab3e1 service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Received unexpected event network-vif-plugged-e58dc647-6432-4d80-82f6-4917696714ba for instance with vm_state active and task_state None. Jun 25 04:44:43.330854 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-530fcf16-9069-4b07-bef4-1ac424c218bd req-d424e392-e811-4cf5-a1a9-db9cc36ab3e1 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-2af2f66c-7de8-49e4-badd-16d0764caff6 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:43.331134 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-530fcf16-9069-4b07-bef4-1ac424c218bd req-d424e392-e811-4cf5-a1a9-db9cc36ab3e1 service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:43.331829 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-530fcf16-9069-4b07-bef4-1ac424c218bd req-d424e392-e811-4cf5-a1a9-db9cc36ab3e1 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:43.331964 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-530fcf16-9069-4b07-bef4-1ac424c218bd req-d424e392-e811-4cf5-a1a9-db9cc36ab3e1 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:43.332039 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-530fcf16-9069-4b07-bef4-1ac424c218bd req-d424e392-e811-4cf5-a1a9-db9cc36ab3e1 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] No waiting events found dispatching network-vif-unplugged-2af2f66c-7de8-49e4-badd-16d0764caff6 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:43.332202 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-530fcf16-9069-4b07-bef4-1ac424c218bd req-d424e392-e811-4cf5-a1a9-db9cc36ab3e1 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-2af2f66c-7de8-49e4-badd-16d0764caff6 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:43.342178 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:43.342178 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:43.342178 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:43.342178 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:43.342178 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:43.342178 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:43.342178 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:43.342178 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:43.342178 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:43.342178 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:43.342178 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:43.342178 np0000003587 nova-compute[98952]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:43.342178 np0000003587 nova-compute[98952]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:43.342178 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:43.342178 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:43.342852 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsi session list stdout=tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:43.342852 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:43.342852 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:43.342852 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:43.342852 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:43.342852 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:43.342852 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:43.342852 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:43.342852 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:43.342852 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:43.342852 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:43.342852 np0000003587 nova-compute[98952]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:43.342852 np0000003587 nova-compute[98952]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:43.342852 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:43.342852 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:43.343290 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.262s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:43.343443 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Connected to 192.168.40.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:44:43.345627 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] HCTL ('9', '-', '-', 0) found on session 37 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:44:43.345910 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:44:43.376109 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Searching for a device in session 37 and hctl ['9', '*', '*', 0] yield: sde {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:44:43.376109 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7064d58c-6be7-41d3-ac76-aa6eeef1b479', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:44:43.455713 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:44:43.465883 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:44:43.469246 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-2a6588c1-d915-430e-8e65-ea384dd907b9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.996s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:43.477344 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:43.477502 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:43.477591 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:43.478525 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No VIF found with MAC fa:16:3e:57:c0:7f, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:44:43.478525 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Using config drive Jun 25 04:44:43.712402 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Updating instance_info_cache with network_info: [{"id": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "address": "fa:16:3e:01:4b:19", "network": {"id": "42b56fcf-0521-41b0-90c0-19763fa22d07", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-808831530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "531c29726a504313bae3835b93c9c5eb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea2b8f9-a1", "ovs_interfaceid": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:44:43.792279 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:43.823910 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:43.951132 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:43.972089 np0000003587 nova-compute[98952]: DEBUG nova.utils [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Queued Task(fn=>, remaining_delay=14.999558222999894 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:44.020360 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:44.068984 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-22fd01da-9056-4cd0-8489-c9f005bb66a5 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:44.069177 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:44.069351 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:44.069476 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:44.070305 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] No waiting events found dispatching network-vif-unplugged-22fd01da-9056-4cd0-8489-c9f005bb66a5 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:44.070665 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-22fd01da-9056-4cd0-8489-c9f005bb66a5 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:44.070875 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-ff5a5c31-e634-489a-b565-418e87aaa11b {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:44.071968 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:44.071968 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:44.072128 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:44.072197 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] No waiting events found dispatching network-vif-unplugged-ff5a5c31-e634-489a-b565-418e87aaa11b {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:44.072345 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-ff5a5c31-e634-489a-b565-418e87aaa11b for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:44.072481 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-ff5a5c31-e634-489a-b565-418e87aaa11b {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:44.073212 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:44.073212 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:44.073212 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:44.073775 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] No waiting events found dispatching network-vif-unplugged-ff5a5c31-e634-489a-b565-418e87aaa11b {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:44.076970 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-ff5a5c31-e634-489a-b565-418e87aaa11b for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:44.078032 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-a36eb1f7-4779-4078-a224-bc487abd01a6 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:44.078356 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:44.078630 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:44.078822 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:44.078866 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] No waiting events found dispatching network-vif-unplugged-a36eb1f7-4779-4078-a224-bc487abd01a6 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:44.079291 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-a36eb1f7-4779-4078-a224-bc487abd01a6 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:44.079291 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-a36eb1f7-4779-4078-a224-bc487abd01a6 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:44.079291 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:44.079409 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:44.079697 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:44.079965 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] No waiting events found dispatching network-vif-unplugged-a36eb1f7-4779-4078-a224-bc487abd01a6 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:44.080172 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d30b9fe6-a320-432c-9353-be568ed73f0c req-a3439073-f59b-4fa5-9bdb-25ff3578db41 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-a36eb1f7-4779-4078-a224-bc487abd01a6 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:44.086254 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8518b17d-6311-4d29-8088-80fd7482fdcf req-81a9416d-048d-4c4e-8691-a407efeae2a5 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-a7d7f523-bf9e-4f8f-881d-9d05c514eb54 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:44.087412 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8518b17d-6311-4d29-8088-80fd7482fdcf req-81a9416d-048d-4c4e-8691-a407efeae2a5 service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:44.087412 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8518b17d-6311-4d29-8088-80fd7482fdcf req-81a9416d-048d-4c4e-8691-a407efeae2a5 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:44.087412 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8518b17d-6311-4d29-8088-80fd7482fdcf req-81a9416d-048d-4c4e-8691-a407efeae2a5 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:44.087412 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8518b17d-6311-4d29-8088-80fd7482fdcf req-81a9416d-048d-4c4e-8691-a407efeae2a5 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] No waiting events found dispatching network-vif-unplugged-a7d7f523-bf9e-4f8f-881d-9d05c514eb54 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:44.087771 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8518b17d-6311-4d29-8088-80fd7482fdcf req-81a9416d-048d-4c4e-8691-a407efeae2a5 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-a7d7f523-bf9e-4f8f-881d-9d05c514eb54 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:44.116815 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 25 04:44:44.201444 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-c32e8cf0-131b-4e98-bea3-6d4b3e326ddd req-0d861785-c59f-4ce6-9b60-f0350a123dd8 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-ed1393f8-f25b-489d-9635-82b920d33137 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:44.202320 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-c32e8cf0-131b-4e98-bea3-6d4b3e326ddd req-0d861785-c59f-4ce6-9b60-f0350a123dd8 service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:44.202499 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-c32e8cf0-131b-4e98-bea3-6d4b3e326ddd req-0d861785-c59f-4ce6-9b60-f0350a123dd8 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:44.202636 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-c32e8cf0-131b-4e98-bea3-6d4b3e326ddd req-0d861785-c59f-4ce6-9b60-f0350a123dd8 service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:44.203144 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-c32e8cf0-131b-4e98-bea3-6d4b3e326ddd req-0d861785-c59f-4ce6-9b60-f0350a123dd8 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] No waiting events found dispatching network-vif-unplugged-ed1393f8-f25b-489d-9635-82b920d33137 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:44.203144 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-c32e8cf0-131b-4e98-bea3-6d4b3e326ddd req-0d861785-c59f-4ce6-9b60-f0350a123dd8 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-ed1393f8-f25b-489d-9635-82b920d33137 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:44.215181 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Releasing lock "refresh_cache-8b915629-823e-4b55-bc64-d73e58b79bdc" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:44:44.223360 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:44.236338 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:44.241283 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:44.271583 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:44.281174 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:44.450016 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:44.483516 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:44.484126 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:44.610275 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:44.663964 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:44.668695 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:44.727370 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:44:44.974040 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005335799999102164 future=) submitted to {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:44.974171 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:44.974171 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=2.185570683000151 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:44.974318 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=2.1854882899999666 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:44.975839 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Emitting event Stopped> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:44:44.976074 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] VM Stopped (Lifecycle Event) Jun 25 04:44:44.980621 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:45.150389 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Found WWN 1StorPooliSCSI_DISK_1034578903445798962 for multipath device dm-3 {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 25 04:44:45.150389 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.087s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:45.150578 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] <== connect_volume: return (5567ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798962', 'path': '/dev/dm-3', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445798962'} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:44:45.150893 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798962', 'path': '/dev/dm-3', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445798962'} {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 25 04:44:45.151551 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.004s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:45.152217 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '94315545-1fac-434f-9971-01dd561f2296', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 25 04:44:45.152356 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', 0)] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 25 04:44:45.171163 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lazy-loading 'flavor' on Instance uuid 57cfae71-795b-408e-850f-5293a22274c3 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsi session list stdout=tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296 (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '4')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 25 04:44:45.200014 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', '20')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:44:45.203863 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296', '19')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:44:45.205329 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Resulting device map defaultdict(. at 0x7a16b81b37e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296'): ({'sdl'}, set())}) {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 25 04:44:45.206390 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Removing multipathed devices sdm, sdl {{(pid=98952) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 25 04:44:45.206762 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Flush multipath device 330000000029f2a87 {{(pid=98952) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 25 04:44:45.276207 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:44:45.322914 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:44:45.373449 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 25 04:44:45.373449 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 25 04:44:45.374151 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 25 04:44:45.397458 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 25 04:44:45.397458 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296')] {{(pid=98952) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 25 04:44:45.412905 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:45.461677 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6cb0b51c-acd2-4253-805a-d0d75f2f5de0 req-d3801a0c-9b33-4d61-891d-fd7e31429b0e service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-2af2f66c-7de8-49e4-badd-16d0764caff6 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:45.461677 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6cb0b51c-acd2-4253-805a-d0d75f2f5de0 req-d3801a0c-9b33-4d61-891d-fd7e31429b0e service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:45.461677 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6cb0b51c-acd2-4253-805a-d0d75f2f5de0 req-d3801a0c-9b33-4d61-891d-fd7e31429b0e service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:45.461677 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6cb0b51c-acd2-4253-805a-d0d75f2f5de0 req-d3801a0c-9b33-4d61-891d-fd7e31429b0e service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:45.461820 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6cb0b51c-acd2-4253-805a-d0d75f2f5de0 req-d3801a0c-9b33-4d61-891d-fd7e31429b0e service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] No waiting events found dispatching network-vif-unplugged-2af2f66c-7de8-49e4-badd-16d0764caff6 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:45.461998 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6cb0b51c-acd2-4253-805a-d0d75f2f5de0 req-d3801a0c-9b33-4d61-891d-fd7e31429b0e service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-2af2f66c-7de8-49e4-badd-16d0764caff6 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:45.463359 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6cb0b51c-acd2-4253-805a-d0d75f2f5de0 req-d3801a0c-9b33-4d61-891d-fd7e31429b0e service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-07a46cd4-912b-4863-8b8f-f345fe260bd0 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:45.463359 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6cb0b51c-acd2-4253-805a-d0d75f2f5de0 req-d3801a0c-9b33-4d61-891d-fd7e31429b0e service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:45.465590 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6cb0b51c-acd2-4253-805a-d0d75f2f5de0 req-d3801a0c-9b33-4d61-891d-fd7e31429b0e service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:45.465590 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6cb0b51c-acd2-4253-805a-d0d75f2f5de0 req-d3801a0c-9b33-4d61-891d-fd7e31429b0e service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:45.468774 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6cb0b51c-acd2-4253-805a-d0d75f2f5de0 req-d3801a0c-9b33-4d61-891d-fd7e31429b0e service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] No waiting events found dispatching network-vif-unplugged-07a46cd4-912b-4863-8b8f-f345fe260bd0 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:45.470028 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6cb0b51c-acd2-4253-805a-d0d75f2f5de0 req-d3801a0c-9b33-4d61-891d-fd7e31429b0e service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-07a46cd4-912b-4863-8b8f-f345fe260bd0 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:45.474783 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296, portal: 192.168.40.100,3260] Jun 25 04:44:45.474783 np0000003587 nova-compute[98952]: Logout of [sid: 20, target: iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296, portal: 192.168.40.100,3260] successful. Jun 25 04:44:45.474783 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:45.474936 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6cb0b51c-acd2-4253-805a-d0d75f2f5de0 req-d3801a0c-9b33-4d61-891d-fd7e31429b0e service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-07a46cd4-912b-4863-8b8f-f345fe260bd0 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:45.475224 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6cb0b51c-acd2-4253-805a-d0d75f2f5de0 req-d3801a0c-9b33-4d61-891d-fd7e31429b0e service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:45.475429 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6cb0b51c-acd2-4253-805a-d0d75f2f5de0 req-d3801a0c-9b33-4d61-891d-fd7e31429b0e service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:45.475846 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6cb0b51c-acd2-4253-805a-d0d75f2f5de0 req-d3801a0c-9b33-4d61-891d-fd7e31429b0e service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:45.475978 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6cb0b51c-acd2-4253-805a-d0d75f2f5de0 req-d3801a0c-9b33-4d61-891d-fd7e31429b0e service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] No waiting events found dispatching network-vif-unplugged-07a46cd4-912b-4863-8b8f-f345fe260bd0 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:45.476201 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6cb0b51c-acd2-4253-805a-d0d75f2f5de0 req-d3801a0c-9b33-4d61-891d-fd7e31429b0e service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-07a46cd4-912b-4863-8b8f-f345fe260bd0 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:45.476301 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6cb0b51c-acd2-4253-805a-d0d75f2f5de0 req-d3801a0c-9b33-4d61-891d-fd7e31429b0e service nova] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Received event network-vif-plugged-a07a18ad-0e1f-46f0-94e5-0c2a44be555a {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:45.476439 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6cb0b51c-acd2-4253-805a-d0d75f2f5de0 req-d3801a0c-9b33-4d61-891d-fd7e31429b0e service nova] Acquiring lock "2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:45.476693 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6cb0b51c-acd2-4253-805a-d0d75f2f5de0 req-d3801a0c-9b33-4d61-891d-fd7e31429b0e service nova] Lock "2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:45.476857 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6cb0b51c-acd2-4253-805a-d0d75f2f5de0 req-d3801a0c-9b33-4d61-891d-fd7e31429b0e service nova] Lock "2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:45.476996 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6cb0b51c-acd2-4253-805a-d0d75f2f5de0 req-d3801a0c-9b33-4d61-891d-fd7e31429b0e service nova] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Processing event network-vif-plugged-a07a18ad-0e1f-46f0-94e5-0c2a44be555a {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:44:45.486893 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-29dabf59-a22d-4001-93e4-fbb736c7992b tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:44:45.509212 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:45.526736 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:45.574871 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296, portal: 192.168.50.100,3260] Jun 25 04:44:45.574871 np0000003587 nova-compute[98952]: Logout of [sid: 19, target: iqn.2023-03.storpool.com:os--volume-94315545-1fac-434f-9971-01dd561f2296, portal: 192.168.50.100,3260] successful. Jun 25 04:44:45.574871 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:45.608213 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:45.609443 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.457s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:45.609443 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] <== disconnect_volume: return (2462ms) None {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:44:45.609906 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Disconnected iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 25 04:44:45.612349 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] calling os-brick to detach iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 25 04:44:45.612873 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a08f66b0-7f9c-47e4-9418-275768fa9e0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, None), 'kwargs': {'force': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:44:45.613105 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:45.613516 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:45.613881 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a08f66b0-7f9c-47e4-9418-275768fa9e0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 25 04:44:45.614030 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', 0)] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 25 04:44:45.621346 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:44:45.625466 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:44:45.626034 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] VM Started (Lifecycle Event) Jun 25 04:44:45.633496 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Guest created on hypervisor {{(pid=98952) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 25 04:44:45.636014 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Instance spawned successfully. Jun 25 04:44:45.636516 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsi session list stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e (non-flash) Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '4')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 25 04:44:45.662808 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', '21')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:44:45.664473 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e', '22')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:44:45.665811 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Resulting device map defaultdict(. at 0x7a1698331f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e'): ({'sdo'}, set())}) {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 25 04:44:45.665811 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Removing multipathed devices sdn, sdo {{(pid=98952) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 25 04:44:45.665811 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Flush multipath device 330000000abf4f6ed {{(pid=98952) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 25 04:44:45.680631 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Attempting to attach volume 7064d58c-6be7-41d3-ac76-aa6eeef1b479 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98952) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 25 04:44:45.682900 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] attach device xml: Jun 25 04:44:45.682900 np0000003587 nova-compute[98952]: Jun 25 04:44:45.682900 np0000003587 nova-compute[98952]: Jun 25 04:44:45.682900 np0000003587 nova-compute[98952]: Jun 25 04:44:45.682900 np0000003587 nova-compute[98952]: Jun 25 04:44:45.682900 np0000003587 nova-compute[98952]: 7064d58c-6be7-41d3-ac76-aa6eeef1b479 Jun 25 04:44:45.682900 np0000003587 nova-compute[98952]: Jun 25 04:44:45.682900 np0000003587 nova-compute[98952]: Jun 25 04:44:45.682900 np0000003587 nova-compute[98952]: {{(pid=98952) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 25 04:44:45.702631 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:44:45.762833 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:44:45.780880 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:45.810074 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 25 04:44:45.810074 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] SCSI volumes sdn, sdo have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 25 04:44:45.810074 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 25 04:44:45.811771 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:45.820648 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:45.826672 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 25 04:44:45.826672 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e')] {{(pid=98952) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 25 04:44:45.840461 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:45.848355 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:45.889168 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Instance event wait completed in 0 seconds for {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:44:45.893210 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e, portal: 192.168.40.100,3260] Jun 25 04:44:45.893210 np0000003587 nova-compute[98952]: Logout of [sid: 21, target: iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e, portal: 192.168.40.100,3260] successful. Jun 25 04:44:45.893210 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:45.894700 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Instance running successfully. Jun 25 04:44:45.896486 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Failed to set time: agent not configured {{(pid=98952) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}} Jun 25 04:44:45.896683 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5d8f1a67-310b-4de3-bda2-d0832b6e305f tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] finish_migration finished successfully. {{(pid=98952) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12903}} Jun 25 04:44:45.927045 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:45.942222 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:45.999132 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e, portal: 192.168.50.100,3260] Jun 25 04:44:45.999132 np0000003587 nova-compute[98952]: Logout of [sid: 22, target: iqn.2023-03.storpool.com:os--volume-a08f66b0-7f9c-47e4-9418-275768fa9e0e, portal: 192.168.50.100,3260] successful. Jun 25 04:44:45.999132 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:46.024187 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:46.024471 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:46.027025 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] <== disconnect_volume: return (411ms) None {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:44:46.027025 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Disconnected iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 25 04:44:46.033360 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] calling os-brick to detach iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 25 04:44:46.033490 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-13'}, None), 'kwargs': {'force': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:44:46.034198 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:46.034319 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:46.034930 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-13'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 25 04:44:46.035370 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', 0)] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 25 04:44:46.075218 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:46.075218 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:46.075218 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:46.075218 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:46.075218 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:46.075218 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:46.075218 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:46.075218 np0000003587 nova-compute[98952]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:46.075218 np0000003587 nova-compute[98952]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:46.075218 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:46.075218 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:46.075528 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:46.075528 np0000003587 nova-compute[98952]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9 (non-flash) Jun 25 04:44:46.075528 np0000003587 nova-compute[98952]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:46.075528 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:46.075528 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:46.075528 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:46.075528 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:46.075528 np0000003587 nova-compute[98952]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:46.075528 np0000003587 nova-compute[98952]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:46.075528 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:46.075528 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:46.075528 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '4')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 25 04:44:46.075976 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', '24')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:44:46.077310 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9', '23')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:44:46.078432 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Resulting device map defaultdict(. at 0x7a16b81b2a20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9'): ({'sdq'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9'): ({'sdp'}, set())}) {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 25 04:44:46.078645 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Removing multipathed devices sdq, sdp {{(pid=98952) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 25 04:44:46.079002 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Flush multipath device 330000000d4d0e7fa {{(pid=98952) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 25 04:44:46.127532 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:44:46.136237 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:44:46.151759 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:44:46.168354 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Found default for hw_cdrom_bus of ide {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:44:46.168354 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Found default for hw_disk_bus of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:44:46.168637 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Found default for hw_input_bus of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:44:46.168939 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Found default for hw_pointer_model of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:44:46.169285 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Found default for hw_video_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:44:46.169714 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Found default for hw_vif_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:44:46.187440 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Instance destroyed successfully. Jun 25 04:44:46.187910 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:44:46.190156 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lazy-loading 'resources' on Instance uuid 8b915629-823e-4b55-bc64-d73e58b79bdc {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:44:46.219942 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2ebd3db0-4a10-42d8-a48d-2dce2ec9be72 req-7f4eec51-a510-41ee-857e-0f6027f3aaeb service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-a7d7f523-bf9e-4f8f-881d-9d05c514eb54 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:46.219942 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2ebd3db0-4a10-42d8-a48d-2dce2ec9be72 req-7f4eec51-a510-41ee-857e-0f6027f3aaeb service nova] Acquiring lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:46.219942 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2ebd3db0-4a10-42d8-a48d-2dce2ec9be72 req-7f4eec51-a510-41ee-857e-0f6027f3aaeb service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:46.219942 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2ebd3db0-4a10-42d8-a48d-2dce2ec9be72 req-7f4eec51-a510-41ee-857e-0f6027f3aaeb service nova] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:46.219942 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2ebd3db0-4a10-42d8-a48d-2dce2ec9be72 req-7f4eec51-a510-41ee-857e-0f6027f3aaeb service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] No waiting events found dispatching network-vif-unplugged-a7d7f523-bf9e-4f8f-881d-9d05c514eb54 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:46.219942 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2ebd3db0-4a10-42d8-a48d-2dce2ec9be72 req-7f4eec51-a510-41ee-857e-0f6027f3aaeb service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-unplugged-a7d7f523-bf9e-4f8f-881d-9d05c514eb54 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:44:46.219942 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2ebd3db0-4a10-42d8-a48d-2dce2ec9be72 req-7f4eec51-a510-41ee-857e-0f6027f3aaeb service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Received event network-changed-e58dc647-6432-4d80-82f6-4917696714ba {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:46.219942 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2ebd3db0-4a10-42d8-a48d-2dce2ec9be72 req-7f4eec51-a510-41ee-857e-0f6027f3aaeb service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Refreshing instance network info cache due to event network-changed-e58dc647-6432-4d80-82f6-4917696714ba. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:44:46.219942 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2ebd3db0-4a10-42d8-a48d-2dce2ec9be72 req-7f4eec51-a510-41ee-857e-0f6027f3aaeb service nova] Acquiring lock "refresh_cache-d0e9b114-f17b-4b1e-b8e1-b1a821f38974" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:44:46.219942 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2ebd3db0-4a10-42d8-a48d-2dce2ec9be72 req-7f4eec51-a510-41ee-857e-0f6027f3aaeb service nova] Acquired lock "refresh_cache-d0e9b114-f17b-4b1e-b8e1-b1a821f38974" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:44:46.219942 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-2ebd3db0-4a10-42d8-a48d-2dce2ec9be72 req-7f4eec51-a510-41ee-857e-0f6027f3aaeb service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Refreshing network info cache for port e58dc647-6432-4d80-82f6-4917696714ba {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:44:46.242288 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Checking to see if SCSI volumes sdq, sdp have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 25 04:44:46.242595 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] SCSI volumes sdq, sdp have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 25 04:44:46.245832 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Checking to see if device paths {'sdq', 'sdp'} are still under multipathd monitoring {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 25 04:44:46.264430 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Device paths {'sdq', 'sdp'} have been removed from multipathd monitoring. {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 25 04:44:46.264722 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9')] {{(pid=98952) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 25 04:44:46.283690 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:46.327576 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-0a195a39-b29c-4e74-b881-6a949295f517 req-8101e611-52ae-4a66-8bf5-f30c2bb6dcd2 service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Received event network-vif-plugged-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:46.327576 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-0a195a39-b29c-4e74-b881-6a949295f517 req-8101e611-52ae-4a66-8bf5-f30c2bb6dcd2 service nova] Acquiring lock "ea0f9737-865a-4199-9077-b64e88af15db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:46.327680 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-0a195a39-b29c-4e74-b881-6a949295f517 req-8101e611-52ae-4a66-8bf5-f30c2bb6dcd2 service nova] Lock "ea0f9737-865a-4199-9077-b64e88af15db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:46.327898 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-0a195a39-b29c-4e74-b881-6a949295f517 req-8101e611-52ae-4a66-8bf5-f30c2bb6dcd2 service nova] Lock "ea0f9737-865a-4199-9077-b64e88af15db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:46.330927 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-0a195a39-b29c-4e74-b881-6a949295f517 req-8101e611-52ae-4a66-8bf5-f30c2bb6dcd2 service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] No waiting events found dispatching network-vif-plugged-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:46.330927 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-0a195a39-b29c-4e74-b881-6a949295f517 req-8101e611-52ae-4a66-8bf5-f30c2bb6dcd2 service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Received unexpected event network-vif-plugged-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 for instance with vm_state active and task_state resize_finish. Jun 25 04:44:46.334068 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-0a195a39-b29c-4e74-b881-6a949295f517 req-8101e611-52ae-4a66-8bf5-f30c2bb6dcd2 service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Received event network-vif-plugged-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:46.334068 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-0a195a39-b29c-4e74-b881-6a949295f517 req-8101e611-52ae-4a66-8bf5-f30c2bb6dcd2 service nova] Acquiring lock "ea0f9737-865a-4199-9077-b64e88af15db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:46.334068 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-0a195a39-b29c-4e74-b881-6a949295f517 req-8101e611-52ae-4a66-8bf5-f30c2bb6dcd2 service nova] Lock "ea0f9737-865a-4199-9077-b64e88af15db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:46.334068 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-0a195a39-b29c-4e74-b881-6a949295f517 req-8101e611-52ae-4a66-8bf5-f30c2bb6dcd2 service nova] Lock "ea0f9737-865a-4199-9077-b64e88af15db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:46.334068 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-0a195a39-b29c-4e74-b881-6a949295f517 req-8101e611-52ae-4a66-8bf5-f30c2bb6dcd2 service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] No waiting events found dispatching network-vif-plugged-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:46.334068 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-0a195a39-b29c-4e74-b881-6a949295f517 req-8101e611-52ae-4a66-8bf5-f30c2bb6dcd2 service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Received unexpected event network-vif-plugged-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 for instance with vm_state active and task_state resize_finish. Jun 25 04:44:46.334068 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9, portal: 192.168.40.100,3260] Jun 25 04:44:46.334068 np0000003587 nova-compute[98952]: Logout of [sid: 24, target: iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9, portal: 192.168.40.100,3260] successful. Jun 25 04:44:46.334068 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:46.369868 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:46.386483 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:46.430236 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9, portal: 192.168.50.100,3260] Jun 25 04:44:46.430236 np0000003587 nova-compute[98952]: Logout of [sid: 23, target: iqn.2023-03.storpool.com:os--volume-88ff7c97-e5b7-4aaf-8529-ad10c2b94af9, portal: 192.168.50.100,3260] successful. Jun 25 04:44:46.430236 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:46.458445 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:46.458854 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.424s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:46.459026 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] <== disconnect_volume: return (425ms) None {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:44:46.459280 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Disconnected iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 25 04:44:46.459900 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Deleting instance files /opt/stack/data/nova/instances/25ee71dc-21c1-4ed4-b3d4-7f8cc107a863_del Jun 25 04:44:46.462495 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Deletion of /opt/stack/data/nova/instances/25ee71dc-21c1-4ed4-b3d4-7f8cc107a863_del complete Jun 25 04:44:46.655021 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] During sync_power_state the instance has a pending task (spawning). Skip. Jun 25 04:44:46.655649 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Paused> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:44:46.655649 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] VM Paused (Lifecycle Event) Jun 25 04:44:46.689801 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Took 9.15 seconds to spawn the instance on the hypervisor. Jun 25 04:44:46.690128 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:44:46.695096 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:43:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1333554901',display_name='tempest-TestMinimumBasicScenario-server-1333554901',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-testminimumbasicscenario-server-1333554901',id=20,image_ref='40ab5d2e-8009-4416-96e0-288079826d15',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIMUjcAKLuJ8eQl8//dID0PBJnmyDvj8jV4j3W/51m7kOma0OarvCuVUgOW43HLUNFw2LvTlSfrfcVQOCz1xrYEidkPoXOARpDdyQfAk+vzyNMGN6jSf5rU9xJ0u0BLPg==',key_name='tempest-TestMinimumBasicScenario-1094476213',keypairs=,launch_index=0,launched_at=2026-06-25T04:43:59Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='531c29726a504313bae3835b93c9c5eb',ramdisk_id='',reservation_id='r-unbq8o10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='40ab5d2e-8009-4416-96e0-288079826d15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-653303651',owner_user_name='tempest-TestMinimumBasicScenario-653303651-project-member'},tags=,task_state='reboot_started_hard',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:44:45Z,user_data=None,user_id='b5f65ec37e8e4f43aea1ab1bb0aa3552',uuid=8b915629-823e-4b55-bc64-d73e58b79bdc,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "address": "fa:16:3e:01:4b:19", "network": {"id": "42b56fcf-0521-41b0-90c0-19763fa22d07", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-808831530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "531c29726a504313bae3835b93c9c5eb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea2b8f9-a1", "ovs_interfaceid": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:44:46.695096 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Converting VIF {"id": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "address": "fa:16:3e:01:4b:19", "network": {"id": "42b56fcf-0521-41b0-90c0-19763fa22d07", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-808831530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "531c29726a504313bae3835b93c9c5eb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea2b8f9-a1", "ovs_interfaceid": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:46.701061 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:4b:19,bridge_name='br-int',has_traffic_filtering=True,id=4ea2b8f9-a162-4e7a-a47a-0683ae39bacf,network=Network(42b56fcf-0521-41b0-90c0-19763fa22d07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea2b8f9-a1') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:46.702715 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:4b:19,bridge_name='br-int',has_traffic_filtering=True,id=4ea2b8f9-a162-4e7a-a47a-0683ae39bacf,network=Network(42b56fcf-0521-41b0-90c0-19763fa22d07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea2b8f9-a1') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:44:46.710198 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:46.710405 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ea2b8f9-a1, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:46.712045 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:46.712881 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:46.717465 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:46.719924 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:46.720904 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6a65b13-cc32-4b44-8ddf-2cb991325729) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:46.723066 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-2ebd3db0-4a10-42d8-a48d-2dce2ec9be72 req-7f4eec51-a510-41ee-857e-0f6027f3aaeb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:46.726656 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:46.730465 np0000003587 nova-compute[98952]: INFO os_vif [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:4b:19,bridge_name='br-int',has_traffic_filtering=True,id=4ea2b8f9-a162-4e7a-a47a-0683ae39bacf,network=Network(42b56fcf-0521-41b0-90c0-19763fa22d07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea2b8f9-a1') Jun 25 04:44:46.735872 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] calling os-brick to detach iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 25 04:44:46.735872 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25f2f478-abf9-45a5-8377-8af2524b83dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:44:46.736136 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:46.736416 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:46.736818 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25f2f478-abf9-45a5-8377-8af2524b83dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 25 04:44:46.737015 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', 0)] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 25 04:44:46.785108 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:46.785108 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:46.785108 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:46.785108 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:46.785108 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:46.785108 np0000003587 nova-compute[98952]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:46.785108 np0000003587 nova-compute[98952]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:46.785108 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:46.785108 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:46.785575 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:46.785575 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:46.785575 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:46.785575 np0000003587 nova-compute[98952]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:46.785575 np0000003587 nova-compute[98952]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:46.785575 np0000003587 nova-compute[98952]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:46.785575 np0000003587 nova-compute[98952]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:46.785575 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:46.785575 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:46.785575 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '4')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 25 04:44:46.785575 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', '35')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:44:46.786729 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', '36')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:44:46.788467 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Resulting device map defaultdict(. at 0x7a16b81b1080>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd'): ({'sdg'}, set())}) {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 25 04:44:46.789298 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Removing multipathed devices sdf, sdg {{(pid=98952) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 25 04:44:46.789640 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Flush multipath device 33000000019fbaf06 {{(pid=98952) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 25 04:44:46.834219 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:44:46.882928 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquiring lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:46.883159 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:46.898006 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:44:46.955123 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 25 04:44:46.955489 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 25 04:44:46.958408 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 25 04:44:46.974889 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Took 5.51 seconds to destroy the instance on the hypervisor. Jun 25 04:44:46.976225 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 25 04:44:46.976496 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd')] {{(pid=98952) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 25 04:44:46.982237 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._common.loopingcall [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98952) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 25 04:44:46.982237 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [-] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Deallocating network for instance {{(pid=98952) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 25 04:44:46.982237 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] deallocate_for_instance() {{(pid=98952) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 25 04:44:46.982237 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:46.997221 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:47.050498 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd, portal: 192.168.40.100,3260] Jun 25 04:44:47.050498 np0000003587 nova-compute[98952]: Logout of [sid: 35, target: iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd, portal: 192.168.40.100,3260] successful. Jun 25 04:44:47.050498 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:47.073116 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:47.090760 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:47.138582 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd, portal: 192.168.50.100,3260] Jun 25 04:44:47.138582 np0000003587 nova-compute[98952]: Logout of [sid: 36, target: iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd, portal: 192.168.50.100,3260] successful. Jun 25 04:44:47.138582 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:47.154919 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:47.154919 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:47.154919 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] <== disconnect_volume: return (419ms) None {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:44:47.158002 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Disconnected iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 25 04:44:47.161464 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Start _get_guest_xml network_info=[{"id": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "address": "fa:16:3e:01:4b:19", "network": {"id": "42b56fcf-0521-41b0-90c0-19763fa22d07", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-808831530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "531c29726a504313bae3835b93c9c5eb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea2b8f9-a1", "ovs_interfaceid": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=40ab5d2e-8009-4416-96e0-288079826d15,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '40ab5d2e-8009-4416-96e0-288079826d15'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25f2f478-abf9-45a5-8377-8af2524b83dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, 'status': 'reserved', 'instance': '8b915629-823e-4b55-bc64-d73e58b79bdc', 'attached_at': '', 'detached_at': '', 'volume_id': '25f2f478-abf9-45a5-8377-8af2524b83dd', 'serial': '25f2f478-abf9-45a5-8377-8af2524b83dd'}, 'attachment_id': '82d1c32a-0140-4f4b-9476-e5ff70c7c47f', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:44:47.163001 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:44:47.163524 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0037443769999754295 future=) submitted to {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:47.163626 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:47.163766 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=11.807834600999968 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:47.163862 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=11.807703488000016 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:47.164411 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Emitting event Stopped> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:44:47.164585 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] VM Stopped (Lifecycle Event) Jun 25 04:44:47.167493 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:44:47.167745 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] VM Resumed (Lifecycle Event) Jun 25 04:44:47.171295 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:44:47.172882 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='40ab5d2e-8009-4416-96e0-288079826d15', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1333554901', uuid='8b915629-823e-4b55-bc64-d73e58b79bdc'), owner=OwnerMeta(userid='b5f65ec37e8e4f43aea1ab1bb0aa3552', username='tempest-TestMinimumBasicScenario-653303651-project-member', projectid='531c29726a504313bae3835b93c9c5eb', projectname='tempest-TestMinimumBasicScenario-653303651'), image=ImageMeta(id='40ab5d2e-8009-4416-96e0-288079826d15', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "address": "fa:16:3e:01:4b:19", "network": {"id": "42b56fcf-0521-41b0-90c0-19763fa22d07", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-808831530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "531c29726a504313bae3835b93c9c5eb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea2b8f9-a1", "ovs_interfaceid": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362687.172413) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:44:47.178722 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:44:47.178722 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:44:47.180794 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:44:47.180794 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:44:47.181463 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:44:47.181463 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=40ab5d2e-8009-4416-96e0-288079826d15,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:44:47.191864 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:44:47.192899 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:44:47.192899 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:44:47.192899 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:44:47.192899 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:44:47.193140 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:44:47.193422 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:44:47.193422 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:44:47.193887 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:44:47.193887 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:44:47.194017 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8b915629-823e-4b55-bc64-d73e58b79bdc {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:44:47.208018 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Took 15.13 seconds to build instance. Jun 25 04:44:47.261054 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:47.321104 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-2ebd3db0-4a10-42d8-a48d-2dce2ec9be72 req-7f4eec51-a510-41ee-857e-0f6027f3aaeb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:47.387998 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:44:47.402879 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:47.403256 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:47.403434 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:47.403573 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] No VIF found with MAC fa:16:3e:cd:9b:6f, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:44:47.543009 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-2ebd3db0-4a10-42d8-a48d-2dce2ec9be72 req-7f4eec51-a510-41ee-857e-0f6027f3aaeb service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Updated VIF entry in instance network info cache for port e58dc647-6432-4d80-82f6-4917696714ba. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:44:47.543434 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-2ebd3db0-4a10-42d8-a48d-2dce2ec9be72 req-7f4eec51-a510-41ee-857e-0f6027f3aaeb service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Updating instance_info_cache with network_info: [{"id": "e58dc647-6432-4d80-82f6-4917696714ba", "address": "fa:16:3e:54:f0:58", "network": {"id": "778b960f-1779-4399-aec5-b9ce77e8af12", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127978990-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "394c4d7e8a6f4b7e8fbefeb88f1f4022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape58dc647-64", "ovs_interfaceid": "e58dc647-6432-4d80-82f6-4917696714ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:44:47.562787 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d2b493e7-fbca-4de8-b45f-de1765aaa07e req-2448d693-482a-4221-ad88-5a25c6f791d3 service nova] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Received event network-vif-plugged-a07a18ad-0e1f-46f0-94e5-0c2a44be555a {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:47.562849 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2b493e7-fbca-4de8-b45f-de1765aaa07e req-2448d693-482a-4221-ad88-5a25c6f791d3 service nova] Acquiring lock "2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:47.563086 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2b493e7-fbca-4de8-b45f-de1765aaa07e req-2448d693-482a-4221-ad88-5a25c6f791d3 service nova] Lock "2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:47.563238 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2b493e7-fbca-4de8-b45f-de1765aaa07e req-2448d693-482a-4221-ad88-5a25c6f791d3 service nova] Lock "2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:47.563386 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d2b493e7-fbca-4de8-b45f-de1765aaa07e req-2448d693-482a-4221-ad88-5a25c6f791d3 service nova] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] No waiting events found dispatching network-vif-plugged-a07a18ad-0e1f-46f0-94e5-0c2a44be555a {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:47.563531 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-d2b493e7-fbca-4de8-b45f-de1765aaa07e req-2448d693-482a-4221-ad88-5a25c6f791d3 service nova] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Received unexpected event network-vif-plugged-a07a18ad-0e1f-46f0-94e5-0c2a44be555a for instance with vm_state active and task_state None. Jun 25 04:44:47.564324 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d2b493e7-fbca-4de8-b45f-de1765aaa07e req-2448d693-482a-4221-ad88-5a25c6f791d3 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Received event network-vif-unplugged-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:47.564583 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2b493e7-fbca-4de8-b45f-de1765aaa07e req-2448d693-482a-4221-ad88-5a25c6f791d3 service nova] Acquiring lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:47.564829 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2b493e7-fbca-4de8-b45f-de1765aaa07e req-2448d693-482a-4221-ad88-5a25c6f791d3 service nova] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:47.565165 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2b493e7-fbca-4de8-b45f-de1765aaa07e req-2448d693-482a-4221-ad88-5a25c6f791d3 service nova] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:47.565326 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d2b493e7-fbca-4de8-b45f-de1765aaa07e req-2448d693-482a-4221-ad88-5a25c6f791d3 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] No waiting events found dispatching network-vif-unplugged-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:47.565507 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-d2b493e7-fbca-4de8-b45f-de1765aaa07e req-2448d693-482a-4221-ad88-5a25c6f791d3 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Received unexpected event network-vif-unplugged-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf for instance with vm_state active and task_state reboot_started_hard. Jun 25 04:44:47.565731 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d2b493e7-fbca-4de8-b45f-de1765aaa07e req-2448d693-482a-4221-ad88-5a25c6f791d3 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Received event network-vif-unplugged-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:47.566548 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2b493e7-fbca-4de8-b45f-de1765aaa07e req-2448d693-482a-4221-ad88-5a25c6f791d3 service nova] Acquiring lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:47.566548 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2b493e7-fbca-4de8-b45f-de1765aaa07e req-2448d693-482a-4221-ad88-5a25c6f791d3 service nova] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:47.566548 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d2b493e7-fbca-4de8-b45f-de1765aaa07e req-2448d693-482a-4221-ad88-5a25c6f791d3 service nova] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:47.566548 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d2b493e7-fbca-4de8-b45f-de1765aaa07e req-2448d693-482a-4221-ad88-5a25c6f791d3 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] No waiting events found dispatching network-vif-unplugged-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:47.566548 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-d2b493e7-fbca-4de8-b45f-de1765aaa07e req-2448d693-482a-4221-ad88-5a25c6f791d3 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Received unexpected event network-vif-unplugged-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf for instance with vm_state active and task_state reboot_started_hard. Jun 25 04:44:47.668408 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 11145d6a-7a4f-4b00-8543-d9b51514d9de] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:44:47.670885 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:44:47.678622 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:44:47.701665 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Object Instance<8b915629-823e-4b55-bc64-d73e58b79bdc> lazy-loaded attributes: resources,vcpu_model {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:44:47.713303 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Lock "2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.649s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:47.717234 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc/disk.config --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:47.734874 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:47.816331 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc/disk.config --force-share --output=json" returned: 0 in 0.100s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:47.816910 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:47.817279 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "/opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:47.821378 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "/opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.004s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:47.822635 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Calling os-brick to attach iSCSI Volume {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 25 04:44:47.826151 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25f2f478-abf9-45a5-8377-8af2524b83dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:44:47.826151 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:47.826151 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:47.826151 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25f2f478-abf9-45a5-8377-8af2524b83dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98952) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 25 04:44:47.836627 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:47.837467 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:47.841129 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:47.841890 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:44:47.842504 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:47.842787 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:44:47.856371 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:44:47.856371 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:47.866216 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:44:47.866216 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:47.874272 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd] added Jun 25 04:44:47.874272 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:44:47.874272 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:44:47.874272 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:44:47.874272 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:44:47.874272 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:44:47.874272 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:47.874688 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:44:47.874688 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.032(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:44:47.875097 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:44:47.876984 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd] added Jun 25 04:44:47.876984 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:44:47.876984 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:44:47.876984 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:44:47.876984 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:44:47.876984 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:44:47.876984 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:47.877265 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:44:47.877513 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0359(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:44:47.877745 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:44:47.960858 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:47.962670 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:47.965228 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:44:47.965327 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Claim successful on node np0000003587 Jun 25 04:44:47.998977 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:44:47.999335 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:44:47.999763 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:44:48.000091 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:44:48.000527 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:44:48.000861 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:44:48.001146 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:44:48.001650 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:44:48.001849 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98952) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 25 04:44:48.002078 np0000003587 nova-compute[98952]: DEBUG oslo_service.periodic_task [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98952) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 04:44:48.045721 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2ebd3db0-4a10-42d8-a48d-2dce2ec9be72 req-7f4eec51-a510-41ee-857e-0f6027f3aaeb service nova] Releasing lock "refresh_cache-d0e9b114-f17b-4b1e-b8e1-b1a821f38974" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:44:48.110793 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquiring lock "bae4d579-c7f2-4be4-b14b-15bab5381102" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:48.110793 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "bae4d579-c7f2-4be4-b14b-15bab5381102" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:48.185078 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:44:48.185078 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: ea0f9737-865a-4199-9077-b64e88af15db] VM Resumed (Lifecycle Event) Jun 25 04:44:48.279338 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5b1ff21a-3680-4671-b005-f15cf428c400 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "ea0f9737-865a-4199-9077-b64e88af15db" by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:48.279580 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5b1ff21a-3680-4671-b005-f15cf428c400 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "ea0f9737-865a-4199-9077-b64e88af15db" acquired by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:48.279998 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-5b1ff21a-3680-4671-b005-f15cf428c400 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Going to confirm migration 1 {{(pid=98952) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}} Jun 25 04:44:48.508633 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:48.613379 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:44:48.686801 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:44:48.690377 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:44:48.787948 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-5b1ff21a-3680-4671-b005-f15cf428c400 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:48.875398 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:44:48.878119 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.50.100 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:44:48.890817 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.40.100 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:44:48.901624 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:48.912429 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-5b1ff21a-3680-4671-b005-f15cf428c400 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:48.912708 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5b1ff21a-3680-4671-b005-f15cf428c400 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "refresh_cache-ea0f9737-865a-4199-9077-b64e88af15db" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:44:48.912851 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5b1ff21a-3680-4671-b005-f15cf428c400 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquired lock "refresh_cache-ea0f9737-865a-4199-9077-b64e88af15db" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:44:48.912902 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-5b1ff21a-3680-4671-b005-f15cf428c400 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:44:48.913036 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-5b1ff21a-3680-4671-b005-f15cf428c400 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lazy-loading 'info_cache' on Instance uuid ea0f9737-865a-4199-9077-b64e88af15db {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:44:48.915231 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:48.916670 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:48.937568 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:48.937568 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:48.937568 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:48.937568 np0000003587 nova-compute[98952]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:48.937568 np0000003587 nova-compute[98952]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:48.937568 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:48.937568 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:48.937568 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:48.937568 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:48.937568 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:48.937568 np0000003587 nova-compute[98952]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:48.937568 np0000003587 nova-compute[98952]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:48.937568 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:48.937568 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:48.945074 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:48.945074 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:48.945074 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:48.945074 np0000003587 nova-compute[98952]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:48.945074 np0000003587 nova-compute[98952]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:48.945074 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:48.945074 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:48.945074 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:48.945074 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:48.945074 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:48.945074 np0000003587 nova-compute[98952]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:48.945074 np0000003587 nova-compute[98952]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:48.945074 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:48.945074 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:48.982216 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd, portal: 192.168.50.100,3260] Jun 25 04:44:48.982216 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd, portal: 192.168.50.100,3260] successful. Jun 25 04:44:48.982216 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:48.988399 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5a0e8a64-182b-4467-b39f-7f22d5ca24bc tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "57cfae71-795b-408e-850f-5293a22274c3" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 10.188s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:49.001405 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd, portal: 192.168.40.100,3260] Jun 25 04:44:49.001405 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd, portal: 192.168.40.100,3260] successful. Jun 25 04:44:49.001405 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:49.001405 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:49.022642 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:49.031679 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:49.031679 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:49.031679 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:49.031679 np0000003587 nova-compute[98952]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:49.031679 np0000003587 nova-compute[98952]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:49.031679 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:49.031679 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:49.031679 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:49.031679 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:49.032513 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:49.032513 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:49.032513 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:49.032513 np0000003587 nova-compute[98952]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:49.032513 np0000003587 nova-compute[98952]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:49.032513 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:49.032513 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:49.032513 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:49.032513 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:49.032513 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.190s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:49.032513 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Connected to 192.168.50.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:44:49.033310 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] HCTL ('11', '-', '-', 0) found on session 39 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:44:49.033466 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:44:49.046269 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:49.046269 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:49.046269 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:49.046269 np0000003587 nova-compute[98952]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:49.046269 np0000003587 nova-compute[98952]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:49.046269 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:49.046269 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:49.046269 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:49.046269 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:49.046269 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:49.046269 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:49.046269 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:49.046269 np0000003587 nova-compute[98952]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:49.046269 np0000003587 nova-compute[98952]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:49.046269 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:49.046269 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:49.046269 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:49.046269 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:49.046269 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.204s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:49.048936 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Connected to 192.168.40.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:44:49.050004 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] HCTL ('12', '-', '-', 0) found on session 40 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:44:49.050004 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:44:49.066078 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Searching for a device in session 39 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:44:49.066078 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '25f2f478-abf9-45a5-8377-8af2524b83dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:44:49.071388 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Searching for a device in session 40 and hctl ['12', '*', '*', 0] yield: None {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:44:49.145074 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d6749507-9bc5-456f-9abb-79d58a0099be req-e90ab693-cb47-4f7e-8591-6bd9ead74e36 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-deleted-2af2f66c-7de8-49e4-badd-16d0764caff6 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:49.147027 np0000003587 nova-compute[98952]: INFO nova.compute.manager [req-d6749507-9bc5-456f-9abb-79d58a0099be req-e90ab693-cb47-4f7e-8591-6bd9ead74e36 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Neutron deleted interface 2af2f66c-7de8-49e4-badd-16d0764caff6; detaching it from the instance and deleting it from the info cache Jun 25 04:44:49.150821 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d6749507-9bc5-456f-9abb-79d58a0099be req-e90ab693-cb47-4f7e-8591-6bd9ead74e36 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Detach interface failed, port_id=2af2f66c-7de8-49e4-badd-16d0764caff6, reason: Instance 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863 could not be found. {{(pid=98952) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 25 04:44:49.195728 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:44:49.195728 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: ea0f9737-865a-4199-9077-b64e88af15db] VM Started (Lifecycle Event) Jun 25 04:44:49.211617 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:49.370387 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-3b0b3d09-ed66-42b1-bac6-5c45ed581651 req-8bb7e286-329c-4b39-95d1-54ca6f4a321e service nova] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Received event network-changed-a07a18ad-0e1f-46f0-94e5-0c2a44be555a {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:49.370387 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-3b0b3d09-ed66-42b1-bac6-5c45ed581651 req-8bb7e286-329c-4b39-95d1-54ca6f4a321e service nova] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Refreshing instance network info cache due to event network-changed-a07a18ad-0e1f-46f0-94e5-0c2a44be555a. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:44:49.370387 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-3b0b3d09-ed66-42b1-bac6-5c45ed581651 req-8bb7e286-329c-4b39-95d1-54ca6f4a321e service nova] Acquiring lock "refresh_cache-2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:44:49.370387 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-3b0b3d09-ed66-42b1-bac6-5c45ed581651 req-8bb7e286-329c-4b39-95d1-54ca6f4a321e service nova] Acquired lock "refresh_cache-2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:44:49.370387 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-3b0b3d09-ed66-42b1-bac6-5c45ed581651 req-8bb7e286-329c-4b39-95d1-54ca6f4a321e service nova] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Refreshing network info cache for port a07a18ad-0e1f-46f0-94e5-0c2a44be555a {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:44:49.463308 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:49.463675 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:49.666191 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-0c5187b5-ec45-4c8d-9a07-c6cbb8de9101 req-e393a07d-9b29-4838-89d1-8ce64fd01040 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-deleted-ed1393f8-f25b-489d-9635-82b920d33137 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:49.666400 np0000003587 nova-compute[98952]: INFO nova.compute.manager [req-0c5187b5-ec45-4c8d-9a07-c6cbb8de9101 req-e393a07d-9b29-4838-89d1-8ce64fd01040 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Neutron deleted interface ed1393f8-f25b-489d-9635-82b920d33137; detaching it from the instance and deleting it from the info cache Jun 25 04:44:49.673821 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-0c5187b5-ec45-4c8d-9a07-c6cbb8de9101 req-e393a07d-9b29-4838-89d1-8ce64fd01040 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Detach interface failed, port_id=ed1393f8-f25b-489d-9635-82b920d33137, reason: Instance 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863 could not be found. {{(pid=98952) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 25 04:44:49.704725 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:44:49.707148 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:44:49.873161 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-3b0b3d09-ed66-42b1-bac6-5c45ed581651 req-8bb7e286-329c-4b39-95d1-54ca6f4a321e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:49.925282 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-5b1ff21a-3680-4671-b005-f15cf428c400 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:49.968222 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lazy-loading 'flavor' on Instance uuid d50f4386-5be2-4ba5-b63f-8cca28d53bbd {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:44:49.977479 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:50.071810 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Searching for a device in session 40 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:44:50.071987 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25f2f478-abf9-45a5-8377-8af2524b83dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:44:50.167870 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:44:50.168189 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:44:50.211618 np0000003587 nova-compute[98952]: DEBUG nova.utils [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Queued Task(fn=>, remaining_delay=14.99957767800015 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:50.285808 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:50.403665 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-3b0b3d09-ed66-42b1-bac6-5c45ed581651 req-8bb7e286-329c-4b39-95d1-54ca6f4a321e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:50.437848 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-5b1ff21a-3680-4671-b005-f15cf428c400 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:50.578373 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-3b0b3d09-ed66-42b1-bac6-5c45ed581651 req-8bb7e286-329c-4b39-95d1-54ca6f4a321e service nova] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Updated VIF entry in instance network info cache for port a07a18ad-0e1f-46f0-94e5-0c2a44be555a. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:44:50.578767 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-3b0b3d09-ed66-42b1-bac6-5c45ed581651 req-8bb7e286-329c-4b39-95d1-54ca6f4a321e service nova] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Updating instance_info_cache with network_info: [{"id": "a07a18ad-0e1f-46f0-94e5-0c2a44be555a", "address": "fa:16:3e:5a:f2:4b", "network": {"id": "413a8e26-e4c1-4fb0-a9b6-bf506b34bcaa", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-326439259-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50a7f42248fa403e902a08ac254c3de7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa07a18ad-0e", "ovs_interfaceid": "a07a18ad-0e1f-46f0-94e5-0c2a44be555a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:44:50.641829 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-5b1ff21a-3680-4671-b005-f15cf428c400 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Updating instance_info_cache with network_info: [{"id": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "address": "fa:16:3e:57:c0:7f", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa68140e2-5c", "ovs_interfaceid": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:44:50.676919 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:44:50.862883 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Found WWN 33000000019fbaf06 for multipath device dm-4 {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 25 04:44:50.863412 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:50.863522 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '33000000019fbaf06', 'path': '/dev/dm-4', 'multipath_id': '33000000019fbaf06'} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:44:50.863716 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000019fbaf06', 'path': '/dev/dm-4', 'multipath_id': '33000000019fbaf06'} {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 25 04:44:50.986330 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.522s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:51.081045 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-3b0b3d09-ed66-42b1-bac6-5c45ed581651 req-8bb7e286-329c-4b39-95d1-54ca6f4a321e service nova] Releasing lock "refresh_cache-2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:44:51.144150 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5b1ff21a-3680-4671-b005-f15cf428c400 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Releasing lock "refresh_cache-ea0f9737-865a-4199-9077-b64e88af15db" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:44:51.144150 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-5b1ff21a-3680-4671-b005-f15cf428c400 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lazy-loading 'migration_context' on Instance uuid ea0f9737-865a-4199-9077-b64e88af15db {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:44:51.194254 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.230s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:51.194254 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:44:51.195624 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 2.687s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:51.198127 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:51.198127 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Auditing locally available compute resources for np0000003587 (node: np0000003587) {{(pid=98952) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 25 04:44:51.198290 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.987s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:51.208268 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:44:51.208268 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Claim successful on node np0000003587 Jun 25 04:44:51.258577 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1d6c8944-674c-484f-951d-87ec4e69d43f req-3da0d978-d5d6-4b43-927b-5e9a006d1d43 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-deleted-a7d7f523-bf9e-4f8f-881d-9d05c514eb54 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:51.267420 np0000003587 nova-compute[98952]: INFO nova.compute.manager [req-1d6c8944-674c-484f-951d-87ec4e69d43f req-3da0d978-d5d6-4b43-927b-5e9a006d1d43 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Neutron deleted interface a7d7f523-bf9e-4f8f-881d-9d05c514eb54; detaching it from the instance and deleting it from the info cache Jun 25 04:44:51.274175 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1d6c8944-674c-484f-951d-87ec4e69d43f req-3da0d978-d5d6-4b43-927b-5e9a006d1d43 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Detach interface failed, port_id=a7d7f523-bf9e-4f8f-881d-9d05c514eb54, reason: Instance 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863 could not be found. {{(pid=98952) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 25 04:44:51.274550 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1d6c8944-674c-484f-951d-87ec4e69d43f req-3da0d978-d5d6-4b43-927b-5e9a006d1d43 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-deleted-22fd01da-9056-4cd0-8489-c9f005bb66a5 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:51.274748 np0000003587 nova-compute[98952]: INFO nova.compute.manager [req-1d6c8944-674c-484f-951d-87ec4e69d43f req-3da0d978-d5d6-4b43-927b-5e9a006d1d43 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Neutron deleted interface 22fd01da-9056-4cd0-8489-c9f005bb66a5; detaching it from the instance and deleting it from the info cache Jun 25 04:44:51.276287 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:51.279489 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1d6c8944-674c-484f-951d-87ec4e69d43f req-3da0d978-d5d6-4b43-927b-5e9a006d1d43 service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Detach interface failed, port_id=22fd01da-9056-4cd0-8489-c9f005bb66a5, reason: Instance 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863 could not be found. {{(pid=98952) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 25 04:44:51.371382 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:43:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1333554901',display_name='tempest-TestMinimumBasicScenario-server-1333554901',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-testminimumbasicscenario-server-1333554901',id=20,image_ref='40ab5d2e-8009-4416-96e0-288079826d15',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIMUjcAKLuJ8eQl8//dID0PBJnmyDvj8jV4j3W/51m7kOma0OarvCuVUgOW43HLUNFw2LvTlSfrfcVQOCz1xrYEidkPoXOARpDdyQfAk+vzyNMGN6jSf5rU9xJ0u0BLPg==',key_name='tempest-TestMinimumBasicScenario-1094476213',keypairs=,launch_index=0,launched_at=2026-06-25T04:43:59Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='531c29726a504313bae3835b93c9c5eb',ramdisk_id='',reservation_id='r-unbq8o10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='40ab5d2e-8009-4416-96e0-288079826d15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-653303651',owner_user_name='tempest-TestMinimumBasicScenario-653303651-project-member'},tags=,task_state='reboot_started_hard',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:44:45Z,user_data=None,user_id='b5f65ec37e8e4f43aea1ab1bb0aa3552',uuid=8b915629-823e-4b55-bc64-d73e58b79bdc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "address": "fa:16:3e:01:4b:19", "network": {"id": "42b56fcf-0521-41b0-90c0-19763fa22d07", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-808831530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "531c29726a504313bae3835b93c9c5eb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea2b8f9-a1", "ovs_interfaceid": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:44:51.371704 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Converting VIF {"id": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "address": "fa:16:3e:01:4b:19", "network": {"id": "42b56fcf-0521-41b0-90c0-19763fa22d07", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-808831530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "531c29726a504313bae3835b93c9c5eb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea2b8f9-a1", "ovs_interfaceid": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:51.372472 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:4b:19,bridge_name='br-int',has_traffic_filtering=True,id=4ea2b8f9-a162-4e7a-a47a-0683ae39bacf,network=Network(42b56fcf-0521-41b0-90c0-19763fa22d07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea2b8f9-a1') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:51.373307 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b915629-823e-4b55-bc64-d73e58b79bdc {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:44:51.500149 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-f34369af-ca6e-4d7e-b7d6-ffd2b44102af req-89fd26c5-c62d-418d-b4aa-07af88ac9eaf service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Received event network-vif-deleted-07a46cd4-912b-4863-8b8f-f345fe260bd0 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:51.500406 np0000003587 nova-compute[98952]: INFO nova.compute.manager [req-f34369af-ca6e-4d7e-b7d6-ffd2b44102af req-89fd26c5-c62d-418d-b4aa-07af88ac9eaf service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Neutron deleted interface 07a46cd4-912b-4863-8b8f-f345fe260bd0; detaching it from the instance and deleting it from the info cache Jun 25 04:44:51.504226 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-f34369af-ca6e-4d7e-b7d6-ffd2b44102af req-89fd26c5-c62d-418d-b4aa-07af88ac9eaf service nova] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Detach interface failed, port_id=07a46cd4-912b-4863-8b8f-f345fe260bd0, reason: Instance 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863 could not be found. {{(pid=98952) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 25 04:44:51.578266 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:44:51.646334 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-5b1ff21a-3680-4671-b005-f15cf428c400 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Object Instance lazy-loaded attributes: info_cache,migration_context {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:44:51.654685 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5b1ff21a-3680-4671-b005-f15cf428c400 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:51.705500 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:44:51.705500 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:44:51.705500 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:51.705500 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:51.722534 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:51.792358 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ecbe28912a3b48e2b7c9023b1615e0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14752bebb0420a9c82e4049038bcc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:44:51.881238 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Object Instance<8b915629-823e-4b55-bc64-d73e58b79bdc> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] End _get_guest_xml xml= Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: 8b915629-823e-4b55-bc64-d73e58b79bdc Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: instance-00000014 Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: 196608 Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: 1 Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: tempest-TestMinimumBasicScenario-server-1333554901 Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: 2026-06-25 04:44:47 Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: 192 Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: 1 Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: 0 Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: 0 Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: 1 Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: True Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: bare Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: 1 Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: 0 Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: ide Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: virtio Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: pc Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: virtio Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: virtio Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: tempest-TestMinimumBasicScenario-653303651-project-member Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: tempest-TestMinimumBasicScenario-653303651 Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: 8b915629-823e-4b55-bc64-d73e58b79bdc Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: 8b915629-823e-4b55-bc64-d73e58b79bdc Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: hvm Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: 128 Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: 1 Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: 25f2f478-abf9-45a5-8377-8af2524b83dd Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:44:51.884862 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:52.008052 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:52.008052 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:52.082171 np0000003587 nova-compute[98952]: INFO nova.compute.manager [-] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Took 5.10 seconds to deallocate network for instance. Jun 25 04:44:52.100157 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:52.100157 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:52.100157 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Attaching volume 7064d58c-6be7-41d3-ac76-aa6eeef1b479 to /dev/vdb Jun 25 04:44:52.115945 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:52.116504 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=98952) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 25 04:44:52.118443 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8b915629-823e-4b55-bc64-d73e58b79bdc {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:44:52.165837 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.80', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003587', 'execute': None}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:44:52.181347 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.scaleio [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98952) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 25 04:44:52.206935 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 25 04:44:52.215527 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Running cmd (subprocess): nvme version {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:52.257244 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] 'nvme version' failed. Not Retrying. {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 04:44:52.257735 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] nvme not present on system {{(pid=98952) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 25 04:44:52.271755 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98952) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 25 04:44:52.275117 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.lightos [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Current host hostNQN and IP(s) are ['10.4.3.80', 'fe80::f816:3eff:feea:dfe4', '192.168.40.6', 'fe80::f816:3eff:fe4f:7c42', '192.168.50.6', 'fe80::f816:3eff:fe6c:e6a6', '192.168.10.6', 'fe80::f816:3eff:fe17:d749', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::b035:28ff:fe70:6f4a', 'fe80::fc16:3eff:fe78:7ac8', 'fe80::1038:1dff:fe1c:d44b', 'fe80::fc16:3eff:fe3a:4858', 'fe80::fc16:3eff:fe4f:4083', 'fe80::fc16:3eff:fecd:9b6f', 'fe80::7cf5:c7ff:fe12:d4dc', 'fe80::fc16:3eff:fe55:5b09', 'fe80::fc16:3eff:fe48:68a7', 'fe80::fc16:3eff:fe54:f058', 'fe80::c80b:26ff:fea1:f17c', 'fe80::fc16:3eff:fe5a:f24b', 'fe80::6c47:21ff:fe4b:e2cc', 'fe80::fc16:3eff:fe57:c07f'] Jun 25 04:44:52.275303 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 25 04:44:52.275678 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] LIGHTOS: no hostnqn found. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 25 04:44:52.276645 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.80', 'host': 'np0000003587', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c81886224652', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a1feb13-40e2-4ac6-989e-b08a6fc0f283', 'nvme_native_multipath': False} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:44:52.276645 np0000003587 nova-compute[98952]: DEBUG nova.virt.block_device [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Updating existing volume attachment record: c3b503a3-e341-48d0-b0ba-f5ca97f4748e {{(pid=98952) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 25 04:44:52.329603 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:52.397531 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Successfully created port: 4a601377-1147-4c58-9ff9-5fb6c1610844 {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:44:52.430339 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:52.430889 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:52.514507 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:52.515164 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] skipping disk /dev/dm-18 (vdb) as it is a volume {{(pid=98952) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 25 04:44:52.523378 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19180a23-a7e0-4354-b9f4-9ca57062fc06/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:52.622272 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Object Instance<8b915629-823e-4b55-bc64-d73e58b79bdc> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:44:52.624163 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2fbd2e10573676a33e3a85c8def8b25910e011b6 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:52.625238 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19180a23-a7e0-4354-b9f4-9ca57062fc06/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:52.625391 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19180a23-a7e0-4354-b9f4-9ca57062fc06/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:52.712181 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Start building block device mappings for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 25 04:44:52.724303 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19180a23-a7e0-4354-b9f4-9ca57062fc06/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:52.729959 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d50f4386-5be2-4ba5-b63f-8cca28d53bbd/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:52.759538 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2fbd2e10573676a33e3a85c8def8b25910e011b6 --force-share --output=json" returned: 0 in 0.135s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:52.760425 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc/disk. size=1073741824 {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 25 04:44:52.761172 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:52.831962 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d50f4386-5be2-4ba5-b63f-8cca28d53bbd/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:52.832743 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d50f4386-5be2-4ba5-b63f-8cca28d53bbd/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:52.871121 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:52.872146 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Cannot resize image /opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc/disk to a smaller size. {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 25 04:44:52.872733 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lazy-loading 'migration_context' on Instance uuid 8b915629-823e-4b55-bc64-d73e58b79bdc {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:44:52.877732 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Calling os-brick to attach iSCSI Volume {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 25 04:44:52.878717 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7064d58c-6be7-41d3-ac76-aa6eeef1b479', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:44:52.879046 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:52.879909 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:52.880210 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7064d58c-6be7-41d3-ac76-aa6eeef1b479', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 25 04:44:52.895980 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:52.896900 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:52.897210 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:44:52.897872 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:44:52.898782 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:44:52.898933 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.startup = automatic Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.scan = manual Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.40.100 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:44:52.913688 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.startup = automatic Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.scan = manual Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.50.100 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:44:52.923462 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:52.930148 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:52.938940 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:44:52.949788 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:52.949788 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:52.949788 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:52.949788 np0000003587 nova-compute[98952]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:52.949788 np0000003587 nova-compute[98952]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:52.949788 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:52.949788 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:52.949788 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:52.949788 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:52.950238 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:52.950238 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:52.950238 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:52.950238 np0000003587 nova-compute[98952]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:52.950238 np0000003587 nova-compute[98952]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:52.950238 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:52.950238 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:52.950238 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:52.950238 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:52.950568 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.054s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:52.950568 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Connected to 192.168.40.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:44:52.951294 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] HCTL ('9', '0', '0', 0) found on session 37 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:44:52.951766 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:44:52.955101 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d50f4386-5be2-4ba5-b63f-8cca28d53bbd/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:52.960626 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57cfae71-795b-408e-850f-5293a22274c3/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:52.973975 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:52.973975 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:52.973975 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:52.973975 np0000003587 nova-compute[98952]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:52.973975 np0000003587 nova-compute[98952]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:52.973975 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:52.973975 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:52.973975 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:52.973975 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:44:52.975302 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:52.975302 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:52.975302 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:44:52.975302 np0000003587 nova-compute[98952]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:52.975302 np0000003587 nova-compute[98952]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:44:52.975302 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:52.975302 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:44:52.975302 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:44:52.975302 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:44:52.975773 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.077s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:52.975961 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Connected to 192.168.50.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:44:52.986835 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Searching for a device in session 37 and hctl ('9', '0', '0', 0) yield: sde {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:44:52.987143 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7064d58c-6be7-41d3-ac76-aa6eeef1b479', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:44:52.992465 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] HCTL ('10', '0', '0', 0) found on session 38 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:44:52.992706 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:44:53.006167 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Searching for a device in session 38 and hctl ('10', '0', '0', 0) yield: sdd {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:44:53.006391 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7064d58c-6be7-41d3-ac76-aa6eeef1b479', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:44:53.063196 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57cfae71-795b-408e-850f-5293a22274c3/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:53.063950 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57cfae71-795b-408e-850f-5293a22274c3/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:53.182180 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57cfae71-795b-408e-850f-5293a22274c3/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:53.183912 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98952) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 25 04:44:53.191044 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98952) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 25 04:44:53.193418 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:53.266105 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Successfully updated port: 4a601377-1147-4c58-9ff9-5fb6c1610844 {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:44:53.314017 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:53.314017 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:53.360853 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2a747b99-f506-4a18-803d-17f6954a53ca req-3b6958ca-e3b6-43a0-b0d8-b093e30f249e service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Received event network-changed-4a601377-1147-4c58-9ff9-5fb6c1610844 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:53.361322 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2a747b99-f506-4a18-803d-17f6954a53ca req-3b6958ca-e3b6-43a0-b0d8-b093e30f249e service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Refreshing instance network info cache due to event network-changed-4a601377-1147-4c58-9ff9-5fb6c1610844. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:44:53.361667 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2a747b99-f506-4a18-803d-17f6954a53ca req-3b6958ca-e3b6-43a0-b0d8-b093e30f249e service nova] Acquiring lock "refresh_cache-e6afb3ec-b48f-4dd6-95a1-d3c097b5203c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:44:53.361817 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2a747b99-f506-4a18-803d-17f6954a53ca req-3b6958ca-e3b6-43a0-b0d8-b093e30f249e service nova] Acquired lock "refresh_cache-e6afb3ec-b48f-4dd6-95a1-d3c097b5203c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:44:53.361953 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-2a747b99-f506-4a18-803d-17f6954a53ca req-3b6958ca-e3b6-43a0-b0d8-b093e30f249e service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Refreshing network info cache for port 4a601377-1147-4c58-9ff9-5fb6c1610844 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:44:53.378336 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Object Instance<8b915629-823e-4b55-bc64-d73e58b79bdc> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:44:53.379878 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:43:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1333554901',display_name='tempest-TestMinimumBasicScenario-server-1333554901',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-testminimumbasicscenario-server-1333554901',id=20,image_ref='40ab5d2e-8009-4416-96e0-288079826d15',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIMUjcAKLuJ8eQl8//dID0PBJnmyDvj8jV4j3W/51m7kOma0OarvCuVUgOW43HLUNFw2LvTlSfrfcVQOCz1xrYEidkPoXOARpDdyQfAk+vzyNMGN6jSf5rU9xJ0u0BLPg==',key_name='tempest-TestMinimumBasicScenario-1094476213',keypairs=,launch_index=0,launched_at=2026-06-25T04:43:59Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=,power_state=1,progress=0,project_id='531c29726a504313bae3835b93c9c5eb',ramdisk_id='',reservation_id='r-unbq8o10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='40ab5d2e-8009-4416-96e0-288079826d15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-653303651',owner_user_name='tempest-TestMinimumBasicScenario-653303651-project-member'},tags=,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:44:45Z,user_data=None,user_id='b5f65ec37e8e4f43aea1ab1bb0aa3552',uuid=8b915629-823e-4b55-bc64-d73e58b79bdc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "address": "fa:16:3e:01:4b:19", "network": {"id": "42b56fcf-0521-41b0-90c0-19763fa22d07", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-808831530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "531c29726a504313bae3835b93c9c5eb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea2b8f9-a1", "ovs_interfaceid": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:44:53.380147 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Converting VIF {"id": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "address": "fa:16:3e:01:4b:19", "network": {"id": "42b56fcf-0521-41b0-90c0-19763fa22d07", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-808831530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "531c29726a504313bae3835b93c9c5eb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea2b8f9-a1", "ovs_interfaceid": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:53.383823 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:4b:19,bridge_name='br-int',has_traffic_filtering=True,id=4ea2b8f9-a162-4e7a-a47a-0683ae39bacf,network=Network(42b56fcf-0521-41b0-90c0-19763fa22d07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea2b8f9-a1') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:53.387859 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:4b:19,bridge_name='br-int',has_traffic_filtering=True,id=4ea2b8f9-a162-4e7a-a47a-0683ae39bacf,network=Network(42b56fcf-0521-41b0-90c0-19763fa22d07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea2b8f9-a1') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:44:53.388535 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:53.388937 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:53.389295 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:44:53.390780 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:53.391003 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c59ba82a-e1ac-5a1d-ab23-0b3623b2f12b', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:53.400064 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:53.406623 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:53.406972 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ea2b8f9-a1, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:53.408475 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ea2b8f9-a1, col_values=(('qos', UUID('919bc51f-e598-4c2c-af8b-b51434c8a6b8')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:53.408475 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ea2b8f9-a1, col_values=(('external_ids', {'iface-id': '4ea2b8f9-a162-4e7a-a47a-0683ae39bacf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:4b:19', 'vm-uuid': '8b915629-823e-4b55-bc64-d73e58b79bdc'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:53.411101 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:53.412623 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:53.420898 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:53.422024 np0000003587 nova-compute[98952]: INFO os_vif [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:4b:19,bridge_name='br-int',has_traffic_filtering=True,id=4ea2b8f9-a162-4e7a-a47a-0683ae39bacf,network=Network(42b56fcf-0521-41b0-90c0-19763fa22d07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea2b8f9-a1') Jun 25 04:44:53.423279 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea0f9737-865a-4199-9077-b64e88af15db/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:53.423756 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] skipping disk /dev/dm-18 (vdb) as it is a volume {{(pid=98952) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 25 04:44:53.426543 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e9b114-f17b-4b1e-b8e1-b1a821f38974/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:53.495578 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:44:53.495578 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:44:53.525869 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e9b114-f17b-4b1e-b8e1-b1a821f38974/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:53.526286 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e9b114-f17b-4b1e-b8e1-b1a821f38974/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:53.626357 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0e9b114-f17b-4b1e-b8e1-b1a821f38974/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:53.634001 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:53.732195 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:53.732757 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:53.754757 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Start spawning the instance on the hypervisor. {{(pid=98952) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 25 04:44:53.757367 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Creating instance directory {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 25 04:44:53.759884 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Creating image(s) Jun 25 04:44:53.761234 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6afb3ec-b48f-4dd6-95a1-d3c097b5203c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:53.761744 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "/opt/stack/data/nova/instances/e6afb3ec-b48f-4dd6-95a1-d3c097b5203c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:53.763484 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "/opt/stack/data/nova/instances/e6afb3ec-b48f-4dd6-95a1-d3c097b5203c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:53.764963 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:44:53.768656 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:44:53.769570 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquiring lock "refresh_cache-e6afb3ec-b48f-4dd6-95a1-d3c097b5203c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:44:53.772912 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:53.833019 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:53.837716 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:53.855811 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Took 1.77 seconds to detach 3 volumes for instance. Jun 25 04:44:53.867846 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-2a747b99-f506-4a18-803d-17f6954a53ca req-3b6958ca-e3b6-43a0-b0d8-b093e30f249e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:53.882380 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.110s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:53.882950 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquiring lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:53.883459 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:53.884227 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:44:53.889371 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:44:53.889371 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:53.911792 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 25 04:44:53.935287 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:53.936103 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:53.998943 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.109s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:54.000994 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:44:54.017155 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:54.027233 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/e6afb3ec-b48f-4dd6-95a1-d3c097b5203c/disk 1073741824 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:54.060182 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:54.067156 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-2a747b99-f506-4a18-803d-17f6954a53ca req-3b6958ca-e3b6-43a0-b0d8-b093e30f249e service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:44:54.072742 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:54.082327 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:44:54.083536 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:54.107969 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/e6afb3ec-b48f-4dd6-95a1-d3c097b5203c/disk 1073741824" returned: 0 in 0.087s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:54.110417 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.226s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:54.111598 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:54.144442 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] CMD "env LANG=C uptime" returned: 0 in 0.057s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:54.146718 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Hypervisor/Node resource view: name=np0000003587 free_ram=49719MB free_disk=72.96162796020508GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98952) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 25 04:44:54.146946 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:54.174741 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:54.233774 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.122s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:54.234695 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6afb3ec-b48f-4dd6-95a1-d3c097b5203c/disk. size=1073741824 {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 25 04:44:54.234695 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6afb3ec-b48f-4dd6-95a1-d3c097b5203c/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:54.306171 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-320947a7-a6c3-4427-abfe-3ed0d2f8a372 req-480eca8d-6764-4ef1-8bad-320048862ff3 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Received event network-vif-plugged-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:54.307974 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-320947a7-a6c3-4427-abfe-3ed0d2f8a372 req-480eca8d-6764-4ef1-8bad-320048862ff3 service nova] Acquiring lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:54.308219 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-320947a7-a6c3-4427-abfe-3ed0d2f8a372 req-480eca8d-6764-4ef1-8bad-320048862ff3 service nova] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:54.308440 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-320947a7-a6c3-4427-abfe-3ed0d2f8a372 req-480eca8d-6764-4ef1-8bad-320048862ff3 service nova] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:54.308898 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-320947a7-a6c3-4427-abfe-3ed0d2f8a372 req-480eca8d-6764-4ef1-8bad-320048862ff3 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] No waiting events found dispatching network-vif-plugged-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:54.308898 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-320947a7-a6c3-4427-abfe-3ed0d2f8a372 req-480eca8d-6764-4ef1-8bad-320048862ff3 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Received unexpected event network-vif-plugged-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf for instance with vm_state active and task_state reboot_started_hard. Jun 25 04:44:54.339743 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6afb3ec-b48f-4dd6-95a1-d3c097b5203c/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:54.340600 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Cannot resize image /opt/stack/data/nova/instances/e6afb3ec-b48f-4dd6-95a1-d3c097b5203c/disk to a smaller size. {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 25 04:44:54.341052 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Created local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 25 04:44:54.341271 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Ensure instance console log exists: /opt/stack/data/nova/instances/e6afb3ec-b48f-4dd6-95a1-d3c097b5203c/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:44:54.341661 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:54.341944 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:54.342586 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:54.375181 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:54.378358 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-2a747b99-f506-4a18-803d-17f6954a53ca req-3b6958ca-e3b6-43a0-b0d8-b093e30f249e service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:44:54.487875 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:54.520711 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:54.524684 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.326s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:54.525248 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:44:54.530894 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5b1ff21a-3680-4671-b005-f15cf428c400 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 2.876s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:54.886977 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2a747b99-f506-4a18-803d-17f6954a53ca req-3b6958ca-e3b6-43a0-b0d8-b093e30f249e service nova] Releasing lock "refresh_cache-e6afb3ec-b48f-4dd6-95a1-d3c097b5203c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:44:54.886977 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquired lock "refresh_cache-e6afb3ec-b48f-4dd6-95a1-d3c097b5203c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:44:54.886977 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:44:54.928830 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Found WWN 3300000004f968a6a for multipath device dm-3 {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 25 04:44:54.929335 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.049s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:44:54.929398 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] <== connect_volume: return (2050ms) {'type': 'block', 'scsi_wwn': '3300000004f968a6a', 'path': '/dev/dm-3', 'multipath_id': '3300000004f968a6a'} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:44:54.929734 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004f968a6a', 'path': '/dev/dm-3', 'multipath_id': '3300000004f968a6a'} {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 25 04:44:54.933711 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lazy-loading 'flavor' on Instance uuid d50f4386-5be2-4ba5-b63f-8cca28d53bbd {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:44:54.978955 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:55.045581 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:44:55.045581 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:44:55.045581 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:55.045581 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:55.139937 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Removed pending STOPPED event for 8b915629-823e-4b55-bc64-d73e58b79bdc due to new event Resumed> {{(pid=98952) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 25 04:44:55.140096 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:44:55.140296 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] VM Resumed (Lifecycle Event) Jun 25 04:44:55.146583 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Instance event wait completed in 0 seconds for {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:44:55.154452 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Instance rebooted successfully. Jun 25 04:44:55.164890 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ecbe28912a3b48e2b7c9023b1615e0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14752bebb0420a9c82e4049038bcc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:44:55.437261 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Attempting to attach volume 7064d58c-6be7-41d3-ac76-aa6eeef1b479 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98952) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 25 04:44:55.439867 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] attach device xml: Jun 25 04:44:55.439867 np0000003587 nova-compute[98952]: Jun 25 04:44:55.439867 np0000003587 nova-compute[98952]: Jun 25 04:44:55.439867 np0000003587 nova-compute[98952]: Jun 25 04:44:55.439867 np0000003587 nova-compute[98952]: Jun 25 04:44:55.439867 np0000003587 nova-compute[98952]: 7064d58c-6be7-41d3-ac76-aa6eeef1b479 Jun 25 04:44:55.439867 np0000003587 nova-compute[98952]: Jun 25 04:44:55.439867 np0000003587 nova-compute[98952]: Jun 25 04:44:55.439867 np0000003587 nova-compute[98952]: {{(pid=98952) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 25 04:44:55.508576 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:44:55.544117 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 25 04:44:55.649790 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:44:55.651894 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:44:55.753257 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Acquiring lock "81e6cb00-9df3-4ea4-b909-e12184673563" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:55.753580 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Lock "81e6cb00-9df3-4ea4-b909-e12184673563" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:55.773204 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:55.849029 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Successfully created port: d6050276-eeb2-40fb-8897-a9985f54776c {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:44:55.961196 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Updating instance_info_cache with network_info: [{"id": "4a601377-1147-4c58-9ff9-5fb6c1610844", "address": "fa:16:3e:59:7d:cd", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a601377-11", "ovs_interfaceid": "4a601377-1147-4c58-9ff9-5fb6c1610844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:44:56.049877 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Start building block device mappings for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 25 04:44:56.136454 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5b1ff21a-3680-4671-b005-f15cf428c400 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:44:56.136790 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-5b1ff21a-3680-4671-b005-f15cf428c400 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:44:56.154494 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] During sync_power_state the instance has a pending task (reboot_started_hard). Skip. Jun 25 04:44:56.154798 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:44:56.154914 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] VM Started (Lifecycle Event) Jun 25 04:44:56.269516 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:44:56.390956 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-cb355f9a-3063-4158-9ce1-8216cee484dc req-59684e9f-8328-465c-b55f-9ec12641f106 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Received event network-vif-plugged-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:56.392715 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-cb355f9a-3063-4158-9ce1-8216cee484dc req-59684e9f-8328-465c-b55f-9ec12641f106 service nova] Acquiring lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:56.393049 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-cb355f9a-3063-4158-9ce1-8216cee484dc req-59684e9f-8328-465c-b55f-9ec12641f106 service nova] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:56.393049 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-cb355f9a-3063-4158-9ce1-8216cee484dc req-59684e9f-8328-465c-b55f-9ec12641f106 service nova] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:56.393049 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-cb355f9a-3063-4158-9ce1-8216cee484dc req-59684e9f-8328-465c-b55f-9ec12641f106 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] No waiting events found dispatching network-vif-plugged-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:44:56.393955 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-cb355f9a-3063-4158-9ce1-8216cee484dc req-59684e9f-8328-465c-b55f-9ec12641f106 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Received unexpected event network-vif-plugged-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf for instance with vm_state active and task_state reboot_started_hard. Jun 25 04:44:56.470953 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Releasing lock "refresh_cache-e6afb3ec-b48f-4dd6-95a1-d3c097b5203c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:44:56.471201 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Instance network_info: |[{"id": "4a601377-1147-4c58-9ff9-5fb6c1610844", "address": "fa:16:3e:59:7d:cd", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a601377-11", "ovs_interfaceid": "4a601377-1147-4c58-9ff9-5fb6c1610844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 25 04:44:56.473301 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Start _get_guest_xml network_info=[{"id": "4a601377-1147-4c58-9ff9-5fb6c1610844", "address": "fa:16:3e:59:7d:cd", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a601377-11", "ovs_interfaceid": "4a601377-1147-4c58-9ff9-5fb6c1610844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '4ecaf199-c1b9-4ce3-869c-178c170c1662'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:44:56.475808 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:44:56.477214 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-65956904', uuid='e6afb3ec-b48f-4dd6-95a1-d3c097b5203c'), owner=OwnerMeta(userid='ecbe28912a3b48e2b7c9023b1615e0cc', username='tempest-ServerRescueNegativeTestJSON-1184161043-project-member', projectid='8c14752bebb0420a9c82e4049038bcc3', projectname='tempest-ServerRescueNegativeTestJSON-1184161043'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4a601377-1147-4c58-9ff9-5fb6c1610844", "address": "fa:16:3e:59:7d:cd", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a601377-11", "ovs_interfaceid": "4a601377-1147-4c58-9ff9-5fb6c1610844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362696.476795) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:44:56.480739 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Successfully updated port: d6050276-eeb2-40fb-8897-a9985f54776c {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:44:56.482163 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:44:56.482753 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:44:56.483904 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:44:56.484171 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:44:56.485292 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:44:56.485806 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:44:56.487176 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:44:56.487305 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:44:56.487472 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:44:56.487590 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:44:56.487722 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:44:56.488254 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:44:56.488678 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:44:56.488809 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:44:56.489892 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:44:56.490073 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:44:56.506316 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:44:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-65956904',display_name='tempest-ServerRescueNegativeTestJSON-server-65956904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-serverrescuenegativetestjson-server-65956904',id=23,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c14752bebb0420a9c82e4049038bcc3',ramdisk_id='',reservation_id='r-y51q94gs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1184161043',owner_user_name='tempest-ServerRescueNegativeTestJSON-1184161043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:44:53Z,user_data=None,user_id='ecbe28912a3b48e2b7c9023b1615e0cc',uuid=e6afb3ec-b48f-4dd6-95a1-d3c097b5203c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a601377-1147-4c58-9ff9-5fb6c1610844", "address": "fa:16:3e:59:7d:cd", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a601377-11", "ovs_interfaceid": "4a601377-1147-4c58-9ff9-5fb6c1610844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:44:56.506961 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Converting VIF {"id": "4a601377-1147-4c58-9ff9-5fb6c1610844", "address": "fa:16:3e:59:7d:cd", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a601377-11", "ovs_interfaceid": "4a601377-1147-4c58-9ff9-5fb6c1610844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:56.507690 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:7d:cd,bridge_name='br-int',has_traffic_filtering=True,id=4a601377-1147-4c58-9ff9-5fb6c1610844,network=Network(06c0ad47-4541-470f-826b-31e1b541d27e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a601377-11') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:56.508506 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lazy-loading 'pci_devices' on Instance uuid e6afb3ec-b48f-4dd6-95a1-d3c097b5203c {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:44:56.539598 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2e6295f6-a902-4459-b8fb-90c70308079a req-9f95e1a8-7f17-42f7-8ea1-403646f4bfe2 service nova] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Received event network-changed-d6050276-eeb2-40fb-8897-a9985f54776c {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:56.539811 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2e6295f6-a902-4459-b8fb-90c70308079a req-9f95e1a8-7f17-42f7-8ea1-403646f4bfe2 service nova] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Refreshing instance network info cache due to event network-changed-d6050276-eeb2-40fb-8897-a9985f54776c. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:44:56.539881 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2e6295f6-a902-4459-b8fb-90c70308079a req-9f95e1a8-7f17-42f7-8ea1-403646f4bfe2 service nova] Acquiring lock "refresh_cache-bae4d579-c7f2-4be4-b14b-15bab5381102" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:44:56.540015 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2e6295f6-a902-4459-b8fb-90c70308079a req-9f95e1a8-7f17-42f7-8ea1-403646f4bfe2 service nova] Acquired lock "refresh_cache-bae4d579-c7f2-4be4-b14b-15bab5381102" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:44:56.540173 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-2e6295f6-a902-4459-b8fb-90c70308079a req-9f95e1a8-7f17-42f7-8ea1-403646f4bfe2 service nova] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Refreshing network info cache for port d6050276-eeb2-40fb-8897-a9985f54776c {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:44:56.639665 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-5b1ff21a-3680-4671-b005-f15cf428c400 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:44:56.666485 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:44:56.666485 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:44:56.679100 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:56.682218 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:56.682218 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:56.682218 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] No VIF found with MAC fa:16:3e:01:4b:19, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:44:56.682218 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:44:56.834903 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:56.983349 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquiring lock "refresh_cache-bae4d579-c7f2-4be4-b14b-15bab5381102" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] End _get_guest_xml xml= Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: instance-00000017 Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: 196608 Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: 1 Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: tempest-ServerRescueNegativeTestJSON-server-65956904 Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: 2026-06-25 04:44:56 Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: 192 Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: 1 Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: 0 Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: 0 Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: 1 Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: True Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: bare Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: 1 Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: 0 Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: virtio Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: tempest-ServerRescueNegativeTestJSON-1184161043-project-member Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: tempest-ServerRescueNegativeTestJSON-1184161043 Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: hvm Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: 128 Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: 1 Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: Jun 25 04:44:57.011638 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:44:57.015077 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Preparing to wait for external event network-vif-plugged-4a601377-1147-4c58-9ff9-5fb6c1610844 {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:44:57.015077 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquiring lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:57.015077 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:57.015077 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:57.015077 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:44:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-65956904',display_name='tempest-ServerRescueNegativeTestJSON-server-65956904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-serverrescuenegativetestjson-server-65956904',id=23,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c14752bebb0420a9c82e4049038bcc3',ramdisk_id='',reservation_id='r-y51q94gs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1184161043',owner_user_name='tempest-ServerRescueNegativeTestJSON-1184161043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:44:53Z,user_data=None,user_id='ecbe28912a3b48e2b7c9023b1615e0cc',uuid=e6afb3ec-b48f-4dd6-95a1-d3c097b5203c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a601377-1147-4c58-9ff9-5fb6c1610844", "address": "fa:16:3e:59:7d:cd", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a601377-11", "ovs_interfaceid": "4a601377-1147-4c58-9ff9-5fb6c1610844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:44:57.015077 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Converting VIF {"id": "4a601377-1147-4c58-9ff9-5fb6c1610844", "address": "fa:16:3e:59:7d:cd", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a601377-11", "ovs_interfaceid": "4a601377-1147-4c58-9ff9-5fb6c1610844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:57.016191 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:7d:cd,bridge_name='br-int',has_traffic_filtering=True,id=4a601377-1147-4c58-9ff9-5fb6c1610844,network=Network(06c0ad47-4541-470f-826b-31e1b541d27e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a601377-11') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:57.016278 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:7d:cd,bridge_name='br-int',has_traffic_filtering=True,id=4a601377-1147-4c58-9ff9-5fb6c1610844,network=Network(06c0ad47-4541-470f-826b-31e1b541d27e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a601377-11') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:44:57.017498 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:57.017498 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:57.017498 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:44:57.018888 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:57.019890 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1749658-aa45-5cdb-b442-68f3543a2742', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:57.022596 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:57.022596 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:57.023004 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:57.026454 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:57.027298 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a601377-11, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:57.028101 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a601377-11, col_values=(('qos', UUID('b6c9a7b2-900d-45b6-95d6-2d8a21b7f9f3')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:57.028605 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a601377-11, col_values=(('external_ids', {'iface-id': '4a601377-1147-4c58-9ff9-5fb6c1610844', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:7d:cd', 'vm-uuid': 'e6afb3ec-b48f-4dd6-95a1-d3c097b5203c'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:44:57.033363 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:57.033363 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:44:57.039850 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:57.040304 np0000003587 nova-compute[98952]: INFO os_vif [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:7d:cd,bridge_name='br-int',has_traffic_filtering=True,id=4a601377-1147-4c58-9ff9-5fb6c1610844,network=Network(06c0ad47-4541-470f-826b-31e1b541d27e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a601377-11') Jun 25 04:44:57.043998 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-2e6295f6-a902-4459-b8fb-90c70308079a req-9f95e1a8-7f17-42f7-8ea1-403646f4bfe2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:57.059690 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Start spawning the instance on the hypervisor. {{(pid=98952) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 25 04:44:57.062950 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Creating instance directory {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 25 04:44:57.062950 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Creating image(s) Jun 25 04:44:57.063407 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquiring lock "/opt/stack/data/nova/instances/bae4d579-c7f2-4be4-b14b-15bab5381102/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:57.064178 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "/opt/stack/data/nova/instances/bae4d579-c7f2-4be4-b14b-15bab5381102/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:57.066308 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "/opt/stack/data/nova/instances/bae4d579-c7f2-4be4-b14b-15bab5381102/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.003s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:57.066927 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:44:57.072592 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:44:57.076701 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:57.158582 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-2e6295f6-a902-4459-b8fb-90c70308079a req-9f95e1a8-7f17-42f7-8ea1-403646f4bfe2 service nova] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:44:57.164270 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:57.165070 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:57.165768 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:57.165768 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] No VIF found with MAC fa:16:3e:48:68:a7, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:44:57.171832 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] During sync_power_state the instance has a pending task (reboot_started_hard). Skip. Jun 25 04:44:57.183948 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.107s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:57.185715 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquiring lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:57.185885 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:57.186398 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:44:57.194090 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:44:57.194848 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:57.214146 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b476e5c1-6dc5-4beb-869e-a40e5af6de54 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc" "released" by "nova.compute.manager.ComputeManager.reboot_instance..do_reboot_instance" :: held 16.323s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:57.322007 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.126s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:57.323953 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/bae4d579-c7f2-4be4-b14b-15bab5381102/disk 1073741824 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:57.393143 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/bae4d579-c7f2-4be4-b14b-15bab5381102/disk 1073741824" returned: 0 in 0.070s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:57.393874 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.208s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:57.394370 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:57.453986 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-2e6295f6-a902-4459-b8fb-90c70308079a req-9f95e1a8-7f17-42f7-8ea1-403646f4bfe2 service nova] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:44:57.491836 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.097s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:57.492147 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bae4d579-c7f2-4be4-b14b-15bab5381102/disk. size=1073741824 {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 25 04:44:57.492387 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bae4d579-c7f2-4be4-b14b-15bab5381102/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:57.591352 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bae4d579-c7f2-4be4-b14b-15bab5381102/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:57.592436 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Cannot resize image /opt/stack/data/nova/instances/bae4d579-c7f2-4be4-b14b-15bab5381102/disk to a smaller size. {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 25 04:44:57.592938 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Created local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 25 04:44:57.593218 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Ensure instance console log exists: /opt/stack/data/nova/instances/bae4d579-c7f2-4be4-b14b-15bab5381102/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:44:57.593788 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:57.593995 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:57.594132 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:57.656682 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5b1ff21a-3680-4671-b005-f15cf428c400 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 3.126s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:57.661177 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 3.510s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:57.957464 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2e6295f6-a902-4459-b8fb-90c70308079a req-9f95e1a8-7f17-42f7-8ea1-403646f4bfe2 service nova] Releasing lock "refresh_cache-bae4d579-c7f2-4be4-b14b-15bab5381102" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:44:57.958798 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquired lock "refresh_cache-bae4d579-c7f2-4be4-b14b-15bab5381102" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:44:57.958798 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:44:58.320524 np0000003587 nova-compute[98952]: INFO nova.scheduler.client.report [None req-5b1ff21a-3680-4671-b005-f15cf428c400 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Deleted allocation for migration 767fda44-409a-415f-9e90-060b3e04c126 Jun 25 04:44:58.394144 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=98952) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 25 04:44:58.565525 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:58.565739 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:44:58.565848 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] No VIF found with MAC fa:16:3e:59:7d:cd, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:44:58.566508 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Using config drive Jun 25 04:44:58.571885 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:44:58.638347 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-984a3e30-ab59-4ce2-8f3e-9c3ab53a7f28 req-4f521e29-a8b8-4b37-b749-98f445b301cf service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Received event network-vif-unplugged-4a601377-1147-4c58-9ff9-5fb6c1610844 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:44:58.638723 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-984a3e30-ab59-4ce2-8f3e-9c3ab53a7f28 req-4f521e29-a8b8-4b37-b749-98f445b301cf service nova] Acquiring lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:58.638827 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-984a3e30-ab59-4ce2-8f3e-9c3ab53a7f28 req-4f521e29-a8b8-4b37-b749-98f445b301cf service nova] Lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:58.639063 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-984a3e30-ab59-4ce2-8f3e-9c3ab53a7f28 req-4f521e29-a8b8-4b37-b749-98f445b301cf service nova] Lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:58.639516 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-984a3e30-ab59-4ce2-8f3e-9c3ab53a7f28 req-4f521e29-a8b8-4b37-b749-98f445b301cf service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] No event matching network-vif-unplugged-4a601377-1147-4c58-9ff9-5fb6c1610844 in dict_keys([('network-vif-plugged', '4a601377-1147-4c58-9ff9-5fb6c1610844')]) {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 25 04:44:58.639825 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-984a3e30-ab59-4ce2-8f3e-9c3ab53a7f28 req-4f521e29-a8b8-4b37-b749-98f445b301cf service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Received unexpected event network-vif-unplugged-4a601377-1147-4c58-9ff9-5fb6c1610844 for instance with vm_state building and task_state spawning. Jun 25 04:44:58.750131 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-cb991d47-ced0-4f47-9afd-cdad68591ba6 tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 6.652s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:58.764881 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 9333a704-82ad-4b54-8456-59eb035a2512 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:44:58.765441 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 6ec8e6a5-bd0d-4c67-9f8e-bdb0e15a857d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:44:58.765683 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 19180a23-a7e0-4354-b9f4-9ca57062fc06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:44:58.765901 np0000003587 nova-compute[98952]: WARNING nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863 is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do. Jun 25 04:44:58.766483 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 57cfae71-795b-408e-850f-5293a22274c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:44:58.767573 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance d50f4386-5be2-4ba5-b63f-8cca28d53bbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:44:58.767573 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 520409fb-f97c-4503-b97b-7cecd377102a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:44:58.767573 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 8b915629-823e-4b55-bc64-d73e58b79bdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:44:58.767573 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance ea0f9737-865a-4199-9077-b64e88af15db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:44:58.767573 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance d0e9b114-f17b-4b1e-b8e1-b1a821f38974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:44:58.767573 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:44:58.767817 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance e6afb3ec-b48f-4dd6-95a1-d3c097b5203c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:44:58.767817 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance bae4d579-c7f2-4be4-b14b-15bab5381102 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 25 04:44:58.812778 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:58.827215 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5b1ff21a-3680-4671-b005-f15cf428c400 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "ea0f9737-865a-4199-9077-b64e88af15db" "released" by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" :: held 10.547s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:44:58.972256 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.000591224000118018 future=) submitted to {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:58.972407 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:58.972578 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=6.238523524000129 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:58.972716 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=6.23835479100012 future=) was cancelled while queued, skipping {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:58.973260 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:44:58.975179 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Emitting event Stopped> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:44:58.975375 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] VM Stopped (Lifecycle Event) Jun 25 04:44:59.014933 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Updating instance_info_cache with network_info: [{"id": "d6050276-eeb2-40fb-8897-a9985f54776c", "address": "fa:16:3e:32:f4:b4", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6050276-ee", "ovs_interfaceid": "d6050276-eeb2-40fb-8897-a9985f54776c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:44:59.079807 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:44:59.274386 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Instance 81e6cb00-9df3-4ea4-b909-e12184673563 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98952) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}} Jun 25 04:44:59.274386 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Total usable vcpus: 16, total allocated vcpus: 12 {{(pid=98952) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 25 04:44:59.274386 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Final resource view: name=np0000003587 phys_ram=64301MB used_ram=2880MB phys_disk=95GB used_disk=11GB total_vcpus=16 used_vcpus=12 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:44:54 up 30 min, 2 users, load average: 11.53, 7.41, 3.49\n', 'num_instances': '12', 'num_vm_active': '9', 'num_task_None': '10', 'num_os_type_None': '12', 'num_proj_284d191aa82f453cabcfd18172f74099': '5', 'io_workload': '2', 'num_vm_resized': '1', 'num_proj_f3904801097947c79fdb5c25d592ac04': '2', 'num_proj_531c29726a504313bae3835b93c9c5eb': '1', 'num_proj_394c4d7e8a6f4b7e8fbefeb88f1f4022': '1', 'num_proj_50a7f42248fa403e902a08ac254c3de7': '1', 'num_vm_building': '2', 'num_task_spawning': '2', 'num_proj_8c14752bebb0420a9c82e4049038bcc3': '2'} {{(pid=98952) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 25 04:44:59.278448 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Creating config drive at /opt/stack/data/nova/instances/e6afb3ec-b48f-4dd6-95a1-d3c097b5203c/disk.config Jun 25 04:44:59.282426 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e6afb3ec-b48f-4dd6-95a1-d3c097b5203c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2ps9gacr {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:44:59.338977 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e6afb3ec-b48f-4dd6-95a1-d3c097b5203c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2ps9gacr" returned: 0 in 0.056s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:44:59.478907 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:44:59.517708 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Releasing lock "refresh_cache-bae4d579-c7f2-4be4-b14b-15bab5381102" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:44:59.518697 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Instance network_info: |[{"id": "d6050276-eeb2-40fb-8897-a9985f54776c", "address": "fa:16:3e:32:f4:b4", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6050276-ee", "ovs_interfaceid": "d6050276-eeb2-40fb-8897-a9985f54776c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 25 04:44:59.522583 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Start _get_guest_xml network_info=[{"id": "d6050276-eeb2-40fb-8897-a9985f54776c", "address": "fa:16:3e:32:f4:b4", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6050276-ee", "ovs_interfaceid": "d6050276-eeb2-40fb-8897-a9985f54776c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '4ecaf199-c1b9-4ce3-869c-178c170c1662'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:44:59.526685 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:44:59.528496 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-809981806', uuid='bae4d579-c7f2-4be4-b14b-15bab5381102'), owner=OwnerMeta(userid='ecbe28912a3b48e2b7c9023b1615e0cc', username='tempest-ServerRescueNegativeTestJSON-1184161043-project-member', projectid='8c14752bebb0420a9c82e4049038bcc3', projectname='tempest-ServerRescueNegativeTestJSON-1184161043'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d6050276-eeb2-40fb-8897-a9985f54776c", "address": "fa:16:3e:32:f4:b4", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6050276-ee", "ovs_interfaceid": "d6050276-eeb2-40fb-8897-a9985f54776c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362699.5274396) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:44:59.532110 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:44:59.532310 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:44:59.533881 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:44:59.534294 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:44:59.536376 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:44:59.537341 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:44:59.537341 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:44:59.537341 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:44:59.538665 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:44:59.538665 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:44:59.538665 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:44:59.538665 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:44:59.538665 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:44:59.539083 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:44:59.541467 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:44:59.541467 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:44:59.557356 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-809981806',display_name='tempest-ServerRescueNegativeTestJSON-server-809981806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-serverrescuenegativetestjson-server-809981806',id=24,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c14752bebb0420a9c82e4049038bcc3',ramdisk_id='',reservation_id='r-okzmxzn3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1184161043',owner_user_name='tempest-ServerRescueNegativeTestJSON-1184161043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:44:56Z,user_data=None,user_id='ecbe28912a3b48e2b7c9023b1615e0cc',uuid=bae4d579-c7f2-4be4-b14b-15bab5381102,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6050276-eeb2-40fb-8897-a9985f54776c", "address": "fa:16:3e:32:f4:b4", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6050276-ee", "ovs_interfaceid": "d6050276-eeb2-40fb-8897-a9985f54776c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:44:59.557643 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Converting VIF {"id": "d6050276-eeb2-40fb-8897-a9985f54776c", "address": "fa:16:3e:32:f4:b4", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6050276-ee", "ovs_interfaceid": "d6050276-eeb2-40fb-8897-a9985f54776c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:44:59.558220 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:f4:b4,bridge_name='br-int',has_traffic_filtering=True,id=d6050276-eeb2-40fb-8897-a9985f54776c,network=Network(06c0ad47-4541-470f-826b-31e1b541d27e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6050276-ee') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:44:59.558893 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lazy-loading 'pci_devices' on Instance uuid bae4d579-c7f2-4be4-b14b-15bab5381102 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:44:59.594840 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-495615c8-28fa-4f95-8ded-2a51429394ef tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:44:59.594970 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-495615c8-28fa-4f95-8ded-2a51429394ef tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:44:59.844633 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:59.876036 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:59.878378 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:59.982773 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:44:59.988416 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] End _get_guest_xml xml= Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: bae4d579-c7f2-4be4-b14b-15bab5381102 Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: instance-00000018 Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: 196608 Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: tempest-ServerRescueNegativeTestJSON-server-809981806 Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: 2026-06-25 04:44:59 Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: 192 Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: 0 Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: 0 Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: True Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: bare Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: 0 Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: virtio Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: tempest-ServerRescueNegativeTestJSON-1184161043-project-member Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: tempest-ServerRescueNegativeTestJSON-1184161043 Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: bae4d579-c7f2-4be4-b14b-15bab5381102 Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: bae4d579-c7f2-4be4-b14b-15bab5381102 Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: hvm Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: 128 Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: Jun 25 04:45:00.065029 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:45:00.067844 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Preparing to wait for external event network-vif-plugged-d6050276-eeb2-40fb-8897-a9985f54776c {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:45:00.067844 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquiring lock "bae4d579-c7f2-4be4-b14b-15bab5381102-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:00.067844 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "bae4d579-c7f2-4be4-b14b-15bab5381102-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:00.067844 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "bae4d579-c7f2-4be4-b14b-15bab5381102-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:00.067844 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-809981806',display_name='tempest-ServerRescueNegativeTestJSON-server-809981806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-serverrescuenegativetestjson-server-809981806',id=24,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c14752bebb0420a9c82e4049038bcc3',ramdisk_id='',reservation_id='r-okzmxzn3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1184161043',owner_user_name='tempest-ServerRescueNegativeTestJSON-1184161043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:44:56Z,user_data=None,user_id='ecbe28912a3b48e2b7c9023b1615e0cc',uuid=bae4d579-c7f2-4be4-b14b-15bab5381102,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6050276-eeb2-40fb-8897-a9985f54776c", "address": "fa:16:3e:32:f4:b4", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6050276-ee", "ovs_interfaceid": "d6050276-eeb2-40fb-8897-a9985f54776c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:45:00.067844 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Converting VIF {"id": "d6050276-eeb2-40fb-8897-a9985f54776c", "address": "fa:16:3e:32:f4:b4", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6050276-ee", "ovs_interfaceid": "d6050276-eeb2-40fb-8897-a9985f54776c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:45:00.067844 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:f4:b4,bridge_name='br-int',has_traffic_filtering=True,id=d6050276-eeb2-40fb-8897-a9985f54776c,network=Network(06c0ad47-4541-470f-826b-31e1b541d27e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6050276-ee') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:45:00.067844 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:f4:b4,bridge_name='br-int',has_traffic_filtering=True,id=d6050276-eeb2-40fb-8897-a9985f54776c,network=Network(06c0ad47-4541-470f-826b-31e1b541d27e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6050276-ee') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:45:00.068231 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:00.068630 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:00.068933 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:45:00.070357 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:00.070982 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72947469-30a0-5133-aa41-b516e628c7a0', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:00.072750 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:00.074002 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:45:00.076944 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:00.076944 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6050276-ee, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:00.077715 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6050276-ee, col_values=(('qos', UUID('f7eab109-6ae4-4446-ae1a-132cbb91de0d')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:00.077946 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6050276-ee, col_values=(('external_ids', {'iface-id': 'd6050276-eeb2-40fb-8897-a9985f54776c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:f4:b4', 'vm-uuid': 'bae4d579-c7f2-4be4-b14b-15bab5381102'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:00.081010 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:45:00.087207 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:00.088184 np0000003587 nova-compute[98952]: INFO os_vif [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:f4:b4,bridge_name='br-int',has_traffic_filtering=True,id=d6050276-eeb2-40fb-8897-a9985f54776c,network=Network(06c0ad47-4541-470f-826b-31e1b541d27e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6050276-ee') Jun 25 04:45:00.097831 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-495615c8-28fa-4f95-8ded-2a51429394ef tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Detaching volume 7064d58c-6be7-41d3-ac76-aa6eeef1b479 Jun 25 04:45:00.180778 np0000003587 nova-compute[98952]: INFO nova.virt.block_device [None req-495615c8-28fa-4f95-8ded-2a51429394ef tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Attempting to driver detach volume 7064d58c-6be7-41d3-ac76-aa6eeef1b479 from mountpoint /dev/vdb Jun 25 04:45:00.190282 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-495615c8-28fa-4f95-8ded-2a51429394ef tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Found disk vdb by alias ua-7064d58c-6be7-41d3-ac76-aa6eeef1b479 {{(pid=98952) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 25 04:45:00.196359 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-495615c8-28fa-4f95-8ded-2a51429394ef tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Found disk vdb by alias ua-7064d58c-6be7-41d3-ac76-aa6eeef1b479 {{(pid=98952) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 25 04:45:00.196359 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-495615c8-28fa-4f95-8ded-2a51429394ef tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Attempting to detach device vdb from instance d50f4386-5be2-4ba5-b63f-8cca28d53bbd from the persistent domain config. {{(pid=98952) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 25 04:45:00.196359 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-495615c8-28fa-4f95-8ded-2a51429394ef tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] detach device xml: Jun 25 04:45:00.196359 np0000003587 nova-compute[98952]: Jun 25 04:45:00.196359 np0000003587 nova-compute[98952]: Jun 25 04:45:00.196359 np0000003587 nova-compute[98952]: Jun 25 04:45:00.196359 np0000003587 nova-compute[98952]: Jun 25 04:45:00.196359 np0000003587 nova-compute[98952]: 7064d58c-6be7-41d3-ac76-aa6eeef1b479 Jun 25 04:45:00.196359 np0000003587 nova-compute[98952]: Jun 25 04:45:00.196359 np0000003587 nova-compute[98952]:
Jun 25 04:45:00.196359 np0000003587 nova-compute[98952]: Jun 25 04:45:00.196359 np0000003587 nova-compute[98952]: {{(pid=98952) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 25 04:45:00.205260 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2b9eea58-eecc-4747-ba7a-2406f72f1d9d req-2b23ca62-60ca-4401-b281-300ad45b9046 service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Received event network-changed-a967a2fd-f804-4a2d-b980-fae0336ab02c {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:00.205260 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2b9eea58-eecc-4747-ba7a-2406f72f1d9d req-2b23ca62-60ca-4401-b281-300ad45b9046 service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Refreshing instance network info cache due to event network-changed-a967a2fd-f804-4a2d-b980-fae0336ab02c. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:45:00.205424 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2b9eea58-eecc-4747-ba7a-2406f72f1d9d req-2b23ca62-60ca-4401-b281-300ad45b9046 service nova] Acquiring lock "refresh_cache-520409fb-f97c-4503-b97b-7cecd377102a" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:45:00.205743 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2b9eea58-eecc-4747-ba7a-2406f72f1d9d req-2b23ca62-60ca-4401-b281-300ad45b9046 service nova] Acquired lock "refresh_cache-520409fb-f97c-4503-b97b-7cecd377102a" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:45:00.205998 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-2b9eea58-eecc-4747-ba7a-2406f72f1d9d req-2b23ca62-60ca-4401-b281-300ad45b9046 service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Refreshing network info cache for port a967a2fd-f804-4a2d-b980-fae0336ab02c {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:45:00.212310 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-495615c8-28fa-4f95-8ded-2a51429394ef tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Successfully detached device vdb from instance d50f4386-5be2-4ba5-b63f-8cca28d53bbd from the persistent domain config. Jun 25 04:45:00.212654 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-495615c8-28fa-4f95-8ded-2a51429394ef tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] (1/8): Attempting to detach device vdb with device alias ua-7064d58c-6be7-41d3-ac76-aa6eeef1b479 from instance d50f4386-5be2-4ba5-b63f-8cca28d53bbd from the live domain config. {{(pid=98952) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 25 04:45:00.212963 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-495615c8-28fa-4f95-8ded-2a51429394ef tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] detach device xml: Jun 25 04:45:00.212963 np0000003587 nova-compute[98952]: Jun 25 04:45:00.212963 np0000003587 nova-compute[98952]: Jun 25 04:45:00.212963 np0000003587 nova-compute[98952]: Jun 25 04:45:00.212963 np0000003587 nova-compute[98952]: Jun 25 04:45:00.212963 np0000003587 nova-compute[98952]: 7064d58c-6be7-41d3-ac76-aa6eeef1b479 Jun 25 04:45:00.212963 np0000003587 nova-compute[98952]: Jun 25 04:45:00.212963 np0000003587 nova-compute[98952]:
Jun 25 04:45:00.212963 np0000003587 nova-compute[98952]: Jun 25 04:45:00.212963 np0000003587 nova-compute[98952]: {{(pid=98952) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 25 04:45:00.290817 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:00.297236 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:45:00.297461 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:45:00.307005 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:00.331948 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:00.339892 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:00.703615 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-75f8b775-57bb-4bb9-8d1e-64bd4a132a04 req-836b11de-b7ff-427b-b938-9cb1731e26c9 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Received event network-vif-plugged-4a601377-1147-4c58-9ff9-5fb6c1610844 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:00.703777 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-75f8b775-57bb-4bb9-8d1e-64bd4a132a04 req-836b11de-b7ff-427b-b938-9cb1731e26c9 service nova] Acquiring lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:00.703970 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-75f8b775-57bb-4bb9-8d1e-64bd4a132a04 req-836b11de-b7ff-427b-b938-9cb1731e26c9 service nova] Lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:00.704129 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-75f8b775-57bb-4bb9-8d1e-64bd4a132a04 req-836b11de-b7ff-427b-b938-9cb1731e26c9 service nova] Lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:00.704321 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-75f8b775-57bb-4bb9-8d1e-64bd4a132a04 req-836b11de-b7ff-427b-b938-9cb1731e26c9 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Processing event network-vif-plugged-4a601377-1147-4c58-9ff9-5fb6c1610844 {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:45:00.704491 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-75f8b775-57bb-4bb9-8d1e-64bd4a132a04 req-836b11de-b7ff-427b-b938-9cb1731e26c9 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Received event network-vif-plugged-4a601377-1147-4c58-9ff9-5fb6c1610844 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:00.705271 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-75f8b775-57bb-4bb9-8d1e-64bd4a132a04 req-836b11de-b7ff-427b-b938-9cb1731e26c9 service nova] Acquiring lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:00.705271 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-75f8b775-57bb-4bb9-8d1e-64bd4a132a04 req-836b11de-b7ff-427b-b938-9cb1731e26c9 service nova] Lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:00.705430 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-75f8b775-57bb-4bb9-8d1e-64bd4a132a04 req-836b11de-b7ff-427b-b938-9cb1731e26c9 service nova] Lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:00.705612 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-75f8b775-57bb-4bb9-8d1e-64bd4a132a04 req-836b11de-b7ff-427b-b938-9cb1731e26c9 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] No waiting events found dispatching network-vif-plugged-4a601377-1147-4c58-9ff9-5fb6c1610844 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:00.705753 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-75f8b775-57bb-4bb9-8d1e-64bd4a132a04 req-836b11de-b7ff-427b-b938-9cb1731e26c9 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Received unexpected event network-vif-plugged-4a601377-1147-4c58-9ff9-5fb6c1610844 for instance with vm_state building and task_state spawning. Jun 25 04:45:00.711939 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-2b9eea58-eecc-4747-ba7a-2406f72f1d9d req-2b23ca62-60ca-4401-b281-300ad45b9046 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:00.809708 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:45:00.832224 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Received event ua-7064d58c-6be7-41d3-ac76-aa6eeef1b479> from libvirt while the driver is waiting for it; dispatched. {{(pid=98952) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 25 04:45:00.836164 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-495615c8-28fa-4f95-8ded-2a51429394ef tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7064d58c-6be7-41d3-ac76-aa6eeef1b479 for instance d50f4386-5be2-4ba5-b63f-8cca28d53bbd {{(pid=98952) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 25 04:45:00.840458 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-495615c8-28fa-4f95-8ded-2a51429394ef tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Successfully detached device vdb from instance d50f4386-5be2-4ba5-b63f-8cca28d53bbd from the live domain config. Jun 25 04:45:00.966881 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:45:00.967360 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:45:00.967699 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] VM Started (Lifecycle Event) Jun 25 04:45:00.970980 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Guest created on hypervisor {{(pid=98952) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 25 04:45:00.973193 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Instance spawned successfully. Jun 25 04:45:00.973619 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 25 04:45:01.106393 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-2b9eea58-eecc-4747-ba7a-2406f72f1d9d req-2b23ca62-60ca-4401-b281-300ad45b9046 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:01.318406 np0000003587 nova-compute[98952]: DEBUG nova.compute.resource_tracker [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Compute_service record updated for np0000003587:np0000003587 {{(pid=98952) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 25 04:45:01.318687 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.662s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:01.321938 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 6.949s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:01.321938 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._threading.loopingcall [None req-f196c2ec-a15e-41eb-b686-aeadb26e7567 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98952) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 25 04:45:01.324730 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-2b9eea58-eecc-4747-ba7a-2406f72f1d9d req-2b23ca62-60ca-4401-b281-300ad45b9046 service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Updated VIF entry in instance network info cache for port a967a2fd-f804-4a2d-b980-fae0336ab02c. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:45:01.324730 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-2b9eea58-eecc-4747-ba7a-2406f72f1d9d req-2b23ca62-60ca-4401-b281-300ad45b9046 service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Updating instance_info_cache with network_info: [{"id": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "address": "fa:16:3e:55:5b:09", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa967a2fd-f8", "ovs_interfaceid": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:45:01.326000 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.005s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:01.334146 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.497s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:01.344201 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:45:01.344201 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Claim successful on node np0000003587 Jun 25 04:45:01.391943 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-495615c8-28fa-4f95-8ded-2a51429394ef tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Detected multiple connections on this host for volume: 7064d58c-6be7-41d3-ac76-aa6eeef1b479, skipping target disconnect. Jun 25 04:45:01.423570 np0000003587 nova-compute[98952]: INFO nova.scheduler.client.report [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Deleted allocations for instance 25ee71dc-21c1-4ed4-b3d4-7f8cc107a863 Jun 25 04:45:01.471166 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:01.474666 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:45:01.480667 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Found default for hw_cdrom_bus of ide {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:45:01.480853 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Found default for hw_disk_bus of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:45:01.481275 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Found default for hw_input_bus of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:45:01.481648 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Found default for hw_pointer_model of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:45:01.481977 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Found default for hw_video_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:45:01.482295 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Found default for hw_vif_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:45:01.611063 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:45:01.611265 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:45:01.611390 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] No VIF found with MAC fa:16:3e:32:f4:b4, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:45:01.611918 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Using config drive Jun 25 04:45:01.834755 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2b9eea58-eecc-4747-ba7a-2406f72f1d9d req-2b23ca62-60ca-4401-b281-300ad45b9046 service nova] Releasing lock "refresh_cache-520409fb-f97c-4503-b97b-7cecd377102a" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:45:01.962639 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-495615c8-28fa-4f95-8ded-2a51429394ef tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lazy-loading 'flavor' on Instance uuid d50f4386-5be2-4ba5-b63f-8cca28d53bbd {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:01.978896 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] During sync_power_state the instance has a pending task (spawning). Skip. Jun 25 04:45:01.979243 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Paused> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:45:01.979534 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] VM Paused (Lifecycle Event) Jun 25 04:45:01.987185 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Took 8.23 seconds to spawn the instance on the hypervisor. Jun 25 04:45:01.987751 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:02.116687 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:02.255316 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Creating config drive at /opt/stack/data/nova/instances/bae4d579-c7f2-4be4-b14b-15bab5381102/disk.config Jun 25 04:45:02.259321 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bae4d579-c7f2-4be4-b14b-15bab5381102/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk7bqo6k7 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:02.297672 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-0142ac2f-3c44-44f9-ab34-23b5bfeceaf4 req-fe1f94ad-15a7-434e-b421-977d5b6c7e7a service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Received event network-changed-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:02.297876 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-0142ac2f-3c44-44f9-ab34-23b5bfeceaf4 req-fe1f94ad-15a7-434e-b421-977d5b6c7e7a service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Refreshing instance network info cache due to event network-changed-a68140e2-5c7f-49c9-abbb-fbc11cf20cf2. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:45:02.298279 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-0142ac2f-3c44-44f9-ab34-23b5bfeceaf4 req-fe1f94ad-15a7-434e-b421-977d5b6c7e7a service nova] Acquiring lock "refresh_cache-ea0f9737-865a-4199-9077-b64e88af15db" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:45:02.298340 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-0142ac2f-3c44-44f9-ab34-23b5bfeceaf4 req-fe1f94ad-15a7-434e-b421-977d5b6c7e7a service nova] Acquired lock "refresh_cache-ea0f9737-865a-4199-9077-b64e88af15db" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:45:02.298684 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-0142ac2f-3c44-44f9-ab34-23b5bfeceaf4 req-fe1f94ad-15a7-434e-b421-977d5b6c7e7a service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Refreshing network info cache for port a68140e2-5c7f-49c9-abbb-fbc11cf20cf2 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:45:02.313425 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bae4d579-c7f2-4be4-b14b-15bab5381102/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk7bqo6k7" returned: 0 in 0.054s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:02.436804 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-71e55455-45b6-4a43-bf29-709176e8bbe6 tempest-TaggedBootDevicesTest-2097804610 tempest-TaggedBootDevicesTest-2097804610-project-member] Lock "25ee71dc-21c1-4ed4-b3d4-7f8cc107a863" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 21.486s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:02.483292 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:02.491433 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:45:02.491647 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] VM Resumed (Lifecycle Event) Jun 25 04:45:02.506425 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Took 14.61 seconds to build instance. Jun 25 04:45:02.804291 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-0142ac2f-3c44-44f9-ab34-23b5bfeceaf4 req-fe1f94ad-15a7-434e-b421-977d5b6c7e7a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:02.848718 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:02.882021 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:02.885989 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:02.976793 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-495615c8-28fa-4f95-8ded-2a51429394ef tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 3.382s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:03.002288 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:03.006903 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:45:03.011669 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:03.013266 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-30293570-1e24-4a4e-aa06-5a8feb27620e tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.130s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:03.091712 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:03.174793 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-a7e7e55e-2333-4b6d-8110-f7979b768217 req-cfb09aef-2331-4756-b3d9-1a7be748bd65 service nova] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Received event network-vif-plugged-d6050276-eeb2-40fb-8897-a9985f54776c {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:03.175122 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a7e7e55e-2333-4b6d-8110-f7979b768217 req-cfb09aef-2331-4756-b3d9-1a7be748bd65 service nova] Acquiring lock "bae4d579-c7f2-4be4-b14b-15bab5381102-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:03.175338 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a7e7e55e-2333-4b6d-8110-f7979b768217 req-cfb09aef-2331-4756-b3d9-1a7be748bd65 service nova] Lock "bae4d579-c7f2-4be4-b14b-15bab5381102-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:03.175504 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a7e7e55e-2333-4b6d-8110-f7979b768217 req-cfb09aef-2331-4756-b3d9-1a7be748bd65 service nova] Lock "bae4d579-c7f2-4be4-b14b-15bab5381102-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:03.176915 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-a7e7e55e-2333-4b6d-8110-f7979b768217 req-cfb09aef-2331-4756-b3d9-1a7be748bd65 service nova] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Processing event network-vif-plugged-d6050276-eeb2-40fb-8897-a9985f54776c {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:45:03.356200 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:45:03.356696 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:45:03.398210 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-0142ac2f-3c44-44f9-ab34-23b5bfeceaf4 req-fe1f94ad-15a7-434e-b421-977d5b6c7e7a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:03.574688 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-0142ac2f-3c44-44f9-ab34-23b5bfeceaf4 req-fe1f94ad-15a7-434e-b421-977d5b6c7e7a service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Updated VIF entry in instance network info cache for port a68140e2-5c7f-49c9-abbb-fbc11cf20cf2. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:45:03.575151 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-0142ac2f-3c44-44f9-ab34-23b5bfeceaf4 req-fe1f94ad-15a7-434e-b421-977d5b6c7e7a service nova] [instance: ea0f9737-865a-4199-9077-b64e88af15db] Updating instance_info_cache with network_info: [{"id": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "address": "fa:16:3e:57:c0:7f", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa68140e2-5c", "ovs_interfaceid": "a68140e2-5c7f-49c9-abbb-fbc11cf20cf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:45:03.862181 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:45:04.027470 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:45:04.027470 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] VM Started (Lifecycle Event) Jun 25 04:45:04.028262 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:45:04.034622 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Guest created on hypervisor {{(pid=98952) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 25 04:45:04.038344 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Instance spawned successfully. Jun 25 04:45:04.040417 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 25 04:45:04.077214 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-0142ac2f-3c44-44f9-ab34-23b5bfeceaf4 req-fe1f94ad-15a7-434e-b421-977d5b6c7e7a service nova] Releasing lock "refresh_cache-ea0f9737-865a-4199-9077-b64e88af15db" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:45:04.182164 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "57cfae71-795b-408e-850f-5293a22274c3" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:04.182606 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "57cfae71-795b-408e-850f-5293a22274c3" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:04.370733 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.039s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:04.371265 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:45:04.529596 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:04.531790 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:45:04.551914 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Found default for hw_cdrom_bus of ide {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:45:04.552096 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Found default for hw_disk_bus of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:45:04.552441 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Found default for hw_input_bus of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:45:04.553164 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Found default for hw_pointer_model of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:45:04.553776 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Found default for hw_video_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:45:04.554276 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Found default for hw_vif_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:45:04.686147 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Detaching volume 7064d58c-6be7-41d3-ac76-aa6eeef1b479 Jun 25 04:45:04.738772 np0000003587 nova-compute[98952]: INFO nova.virt.block_device [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Attempting to driver detach volume 7064d58c-6be7-41d3-ac76-aa6eeef1b479 from mountpoint /dev/vdb Jun 25 04:45:04.744127 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Found disk vdb by alias ua-7064d58c-6be7-41d3-ac76-aa6eeef1b479 {{(pid=98952) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 25 04:45:04.745729 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Found disk vdb by alias ua-7064d58c-6be7-41d3-ac76-aa6eeef1b479 {{(pid=98952) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 25 04:45:04.745834 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Attempting to detach device vdb from instance 57cfae71-795b-408e-850f-5293a22274c3 from the persistent domain config. {{(pid=98952) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 25 04:45:04.746338 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] detach device xml: Jun 25 04:45:04.746338 np0000003587 nova-compute[98952]: Jun 25 04:45:04.746338 np0000003587 nova-compute[98952]: Jun 25 04:45:04.746338 np0000003587 nova-compute[98952]: Jun 25 04:45:04.746338 np0000003587 nova-compute[98952]: Jun 25 04:45:04.746338 np0000003587 nova-compute[98952]: 7064d58c-6be7-41d3-ac76-aa6eeef1b479 Jun 25 04:45:04.746338 np0000003587 nova-compute[98952]: Jun 25 04:45:04.746338 np0000003587 nova-compute[98952]:
Jun 25 04:45:04.746338 np0000003587 nova-compute[98952]: Jun 25 04:45:04.746338 np0000003587 nova-compute[98952]: {{(pid=98952) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 25 04:45:04.756941 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Successfully detached device vdb from instance 57cfae71-795b-408e-850f-5293a22274c3 from the persistent domain config. Jun 25 04:45:04.757157 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] (1/8): Attempting to detach device vdb with device alias ua-7064d58c-6be7-41d3-ac76-aa6eeef1b479 from instance 57cfae71-795b-408e-850f-5293a22274c3 from the live domain config. {{(pid=98952) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 25 04:45:04.757516 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] detach device xml: Jun 25 04:45:04.757516 np0000003587 nova-compute[98952]: Jun 25 04:45:04.757516 np0000003587 nova-compute[98952]: Jun 25 04:45:04.757516 np0000003587 nova-compute[98952]: Jun 25 04:45:04.757516 np0000003587 nova-compute[98952]: Jun 25 04:45:04.757516 np0000003587 nova-compute[98952]: 7064d58c-6be7-41d3-ac76-aa6eeef1b479 Jun 25 04:45:04.757516 np0000003587 nova-compute[98952]: Jun 25 04:45:04.757516 np0000003587 nova-compute[98952]:
Jun 25 04:45:04.757516 np0000003587 nova-compute[98952]: Jun 25 04:45:04.757516 np0000003587 nova-compute[98952]: {{(pid=98952) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 25 04:45:04.877524 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:45:04.877714 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:45:04.878876 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:04.878876 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:04.977047 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '623f49d754904441b1a7dda81d8b1621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dcb3dead44d408eb45cdd6509938ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:45:04.985932 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:05.034095 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] During sync_power_state the instance has a pending task (spawning). Skip. Jun 25 04:45:05.034548 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Paused> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:45:05.034792 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] VM Paused (Lifecycle Event) Jun 25 04:45:05.061589 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Took 8.00 seconds to spawn the instance on the hypervisor. Jun 25 04:45:05.061589 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:05.080475 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:05.290372 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-51a4c069-e6c5-4e09-b6c4-b7434ecda0ac req-4f969a51-1b11-4fa8-927f-79a9b7ee36c9 service nova] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Received event network-vif-plugged-d6050276-eeb2-40fb-8897-a9985f54776c {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:05.290799 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-51a4c069-e6c5-4e09-b6c4-b7434ecda0ac req-4f969a51-1b11-4fa8-927f-79a9b7ee36c9 service nova] Acquiring lock "bae4d579-c7f2-4be4-b14b-15bab5381102-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:05.290940 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-51a4c069-e6c5-4e09-b6c4-b7434ecda0ac req-4f969a51-1b11-4fa8-927f-79a9b7ee36c9 service nova] Lock "bae4d579-c7f2-4be4-b14b-15bab5381102-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:05.291112 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-51a4c069-e6c5-4e09-b6c4-b7434ecda0ac req-4f969a51-1b11-4fa8-927f-79a9b7ee36c9 service nova] Lock "bae4d579-c7f2-4be4-b14b-15bab5381102-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:05.291241 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-51a4c069-e6c5-4e09-b6c4-b7434ecda0ac req-4f969a51-1b11-4fa8-927f-79a9b7ee36c9 service nova] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] No waiting events found dispatching network-vif-plugged-d6050276-eeb2-40fb-8897-a9985f54776c {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:05.291649 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-51a4c069-e6c5-4e09-b6c4-b7434ecda0ac req-4f969a51-1b11-4fa8-927f-79a9b7ee36c9 service nova] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Received unexpected event network-vif-plugged-d6050276-eeb2-40fb-8897-a9985f54776c for instance with vm_state active and task_state None. Jun 25 04:45:05.384587 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 25 04:45:05.391285 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:05.539320 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:05.556739 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:45:05.556739 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] VM Resumed (Lifecycle Event) Jun 25 04:45:05.583275 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Took 16.46 seconds to build instance. Jun 25 04:45:05.843921 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Successfully created port: 6a5b83b4-d4b0-44a9-944b-00681f7aee0a {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:45:05.893646 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Start building block device mappings for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 25 04:45:06.061121 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:06.069040 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:45:06.086376 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d0517a2d-3de1-4f04-bd4b-c950d5566f47 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "bae4d579-c7f2-4be4-b14b-15bab5381102" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.976s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:06.572967 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] During sync_power_state the instance has a pending task (rescuing). Skip. Jun 25 04:45:06.605094 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Rescuing Jun 25 04:45:06.605316 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquiring lock "refresh_cache-bae4d579-c7f2-4be4-b14b-15bab5381102" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:45:06.605427 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquired lock "refresh_cache-bae4d579-c7f2-4be4-b14b-15bab5381102" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:45:06.605604 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:45:06.684654 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Successfully updated port: 6a5b83b4-d4b0-44a9-944b-00681f7aee0a {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:45:06.761817 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-c16c334a-cf17-45be-a361-7dec86a913c5 req-c99e8f79-02db-4fd1-ba6e-6b626083f361 service nova] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Received event network-changed-6a5b83b4-d4b0-44a9-944b-00681f7aee0a {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:06.762495 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-c16c334a-cf17-45be-a361-7dec86a913c5 req-c99e8f79-02db-4fd1-ba6e-6b626083f361 service nova] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Refreshing instance network info cache due to event network-changed-6a5b83b4-d4b0-44a9-944b-00681f7aee0a. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:45:06.762674 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-c16c334a-cf17-45be-a361-7dec86a913c5 req-c99e8f79-02db-4fd1-ba6e-6b626083f361 service nova] Acquiring lock "refresh_cache-81e6cb00-9df3-4ea4-b909-e12184673563" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:45:06.762883 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-c16c334a-cf17-45be-a361-7dec86a913c5 req-c99e8f79-02db-4fd1-ba6e-6b626083f361 service nova] Acquired lock "refresh_cache-81e6cb00-9df3-4ea4-b909-e12184673563" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:45:06.762993 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-c16c334a-cf17-45be-a361-7dec86a913c5 req-c99e8f79-02db-4fd1-ba6e-6b626083f361 service nova] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Refreshing network info cache for port 6a5b83b4-d4b0-44a9-944b-00681f7aee0a {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:45:06.905191 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Start spawning the instance on the hypervisor. {{(pid=98952) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 25 04:45:06.906380 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Creating instance directory {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 25 04:45:06.906658 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Creating image(s) Jun 25 04:45:06.907322 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Acquiring lock "/opt/stack/data/nova/instances/81e6cb00-9df3-4ea4-b909-e12184673563/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:06.907482 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Lock "/opt/stack/data/nova/instances/81e6cb00-9df3-4ea4-b909-e12184673563/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:06.908239 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Lock "/opt/stack/data/nova/instances/81e6cb00-9df3-4ea4-b909-e12184673563/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:06.908861 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:45:06.914528 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:45:06.915867 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:07.013801 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.098s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:07.014883 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Acquiring lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:07.019597 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:07.019597 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:45:07.020832 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:45:07.022067 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:07.052142 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Received event ua-7064d58c-6be7-41d3-ac76-aa6eeef1b479> from libvirt while the driver is waiting for it; dispatched. {{(pid=98952) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 25 04:45:07.052665 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7064d58c-6be7-41d3-ac76-aa6eeef1b479 for instance 57cfae71-795b-408e-850f-5293a22274c3 {{(pid=98952) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 25 04:45:07.056327 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Successfully detached device vdb from instance 57cfae71-795b-408e-850f-5293a22274c3 from the live domain config. Jun 25 04:45:07.107707 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] calling os-brick to detach iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 25 04:45:07.108057 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7064d58c-6be7-41d3-ac76-aa6eeef1b479', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:45:07.110546 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:07.112459 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:45:07.115071 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:45:07.115071 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7064d58c-6be7-41d3-ac76-aa6eeef1b479', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 25 04:45:07.115071 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', 0)] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 25 04:45:07.121231 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.099s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:07.121664 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/81e6cb00-9df3-4ea4-b909-e12184673563/disk 1073741824 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:07.163243 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:07.163243 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:07.163243 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:07.163243 np0000003587 nova-compute[98952]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:45:07.163243 np0000003587 nova-compute[98952]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:45:07.163243 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:07.163243 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:07.163243 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:07.163243 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:45:07.163609 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:07.163609 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:07.163609 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:07.163609 np0000003587 nova-compute[98952]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:45:07.163609 np0000003587 nova-compute[98952]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479 (non-flash) Jun 25 04:45:07.163609 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:07.163609 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:07.163609 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:07.163609 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:45:07.163794 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', '40')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 25 04:45:07.163962 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', '37')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:45:07.166293 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479', '38')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:45:07.169744 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Resulting device map defaultdict(. at 0x7a1698483920>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479'): ({'sdd'}, set())}) {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 25 04:45:07.169744 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Removing multipathed devices sde, sdd {{(pid=98952) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 25 04:45:07.169744 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Flush multipath device 3300000004f968a6a {{(pid=98952) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 25 04:45:07.186425 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/81e6cb00-9df3-4ea4-b909-e12184673563/disk 1073741824" returned: 0 in 0.065s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:07.188494 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Acquiring lock "refresh_cache-81e6cb00-9df3-4ea4-b909-e12184673563" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:45:07.190878 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.172s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:07.192446 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:07.212258 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:45:07.266349 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:45:07.268235 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-c16c334a-cf17-45be-a361-7dec86a913c5 req-c99e8f79-02db-4fd1-ba6e-6b626083f361 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:07.304027 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.112s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:07.304775 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81e6cb00-9df3-4ea4-b909-e12184673563/disk. size=1073741824 {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 25 04:45:07.305068 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81e6cb00-9df3-4ea4-b909-e12184673563/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:07.325109 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 25 04:45:07.325109 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 25 04:45:07.328785 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 25 04:45:07.349772 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 25 04:45:07.355231 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479')] {{(pid=98952) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 25 04:45:07.384775 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:07.392450 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-c16c334a-cf17-45be-a361-7dec86a913c5 req-c99e8f79-02db-4fd1-ba6e-6b626083f361 service nova] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:45:07.421324 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81e6cb00-9df3-4ea4-b909-e12184673563/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:07.421324 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Cannot resize image /opt/stack/data/nova/instances/81e6cb00-9df3-4ea4-b909-e12184673563/disk to a smaller size. {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 25 04:45:07.421769 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Created local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 25 04:45:07.423060 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Ensure instance console log exists: /opt/stack/data/nova/instances/81e6cb00-9df3-4ea4-b909-e12184673563/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:45:07.423060 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:07.424161 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:07.424161 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:07.430730 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479, portal: 192.168.40.100,3260] Jun 25 04:45:07.430730 np0000003587 nova-compute[98952]: Logout of [sid: 37, target: iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479, portal: 192.168.40.100,3260] successful. Jun 25 04:45:07.430730 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:07.459429 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:07.479799 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:07.520498 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479, portal: 192.168.50.100,3260] Jun 25 04:45:07.520498 np0000003587 nova-compute[98952]: Logout of [sid: 38, target: iqn.2023-03.storpool.com:os--volume-7064d58c-6be7-41d3-ac76-aa6eeef1b479, portal: 192.168.50.100,3260] successful. Jun 25 04:45:07.520498 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:07.548027 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:07.548027 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.434s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:45:07.548027 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] <== disconnect_volume: return (437ms) None {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:45:07.548632 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Disconnected iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 25 04:45:07.643608 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:07.654142 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-c16c334a-cf17-45be-a361-7dec86a913c5 req-c99e8f79-02db-4fd1-ba6e-6b626083f361 service nova] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:45:07.845146 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Updating instance_info_cache with network_info: [{"id": "d6050276-eeb2-40fb-8897-a9985f54776c", "address": "fa:16:3e:32:f4:b4", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6050276-ee", "ovs_interfaceid": "d6050276-eeb2-40fb-8897-a9985f54776c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:45:08.158941 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-c16c334a-cf17-45be-a361-7dec86a913c5 req-c99e8f79-02db-4fd1-ba6e-6b626083f361 service nova] Releasing lock "refresh_cache-81e6cb00-9df3-4ea4-b909-e12184673563" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:45:08.159617 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Acquired lock "refresh_cache-81e6cb00-9df3-4ea4-b909-e12184673563" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:45:08.161257 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:45:08.165295 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lazy-loading 'flavor' on Instance uuid 57cfae71-795b-408e-850f-5293a22274c3 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:08.347619 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Releasing lock "refresh_cache-bae4d579-c7f2-4be4-b14b-15bab5381102" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:45:08.750572 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:45:08.905119 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:09.082453 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Updating instance_info_cache with network_info: [{"id": "6a5b83b4-d4b0-44a9-944b-00681f7aee0a", "address": "fa:16:3e:f5:86:eb", "network": {"id": "0dc29968-c129-4c9b-b5fa-eae43ec58c07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-650317758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3dcb3dead44d408eb45cdd6509938ff5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5b83b4-d4", "ovs_interfaceid": "6a5b83b4-d4b0-44a9-944b-00681f7aee0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:45:09.173374 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-01e18a22-d76a-4984-870b-28178e63385d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "57cfae71-795b-408e-850f-5293a22274c3" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 4.991s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:09.585923 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Releasing lock "refresh_cache-81e6cb00-9df3-4ea4-b909-e12184673563" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:45:09.587105 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Instance network_info: |[{"id": "6a5b83b4-d4b0-44a9-944b-00681f7aee0a", "address": "fa:16:3e:f5:86:eb", "network": {"id": "0dc29968-c129-4c9b-b5fa-eae43ec58c07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-650317758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3dcb3dead44d408eb45cdd6509938ff5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5b83b4-d4", "ovs_interfaceid": "6a5b83b4-d4b0-44a9-944b-00681f7aee0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 25 04:45:09.589833 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Start _get_guest_xml network_info=[{"id": "6a5b83b4-d4b0-44a9-944b-00681f7aee0a", "address": "fa:16:3e:f5:86:eb", "network": {"id": "0dc29968-c129-4c9b-b5fa-eae43ec58c07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-650317758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3dcb3dead44d408eb45cdd6509938ff5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5b83b4-d4", "ovs_interfaceid": "6a5b83b4-d4b0-44a9-944b-00681f7aee0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '4ecaf199-c1b9-4ce3-869c-178c170c1662'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:45:09.601073 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:45:09.602463 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-1726511870', uuid='81e6cb00-9df3-4ea4-b909-e12184673563'), owner=OwnerMeta(userid='623f49d754904441b1a7dda81d8b1621', username='tempest-ServerStableDeviceRescueTest-1490129076-project-member', projectid='3dcb3dead44d408eb45cdd6509938ff5', projectname='tempest-ServerStableDeviceRescueTest-1490129076'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6a5b83b4-d4b0-44a9-944b-00681f7aee0a", "address": "fa:16:3e:f5:86:eb", "network": {"id": "0dc29968-c129-4c9b-b5fa-eae43ec58c07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-650317758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3dcb3dead44d408eb45cdd6509938ff5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5b83b4-d4", "ovs_interfaceid": "6a5b83b4-d4b0-44a9-944b-00681f7aee0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362709.6019988) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:45:09.616098 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:45:09.616098 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:45:09.617540 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:45:09.620928 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:45:09.624674 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:45:09.625412 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:45:09.625412 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:45:09.625412 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:45:09.625760 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:45:09.625973 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:45:09.625973 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:45:09.626162 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:45:09.626309 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:45:09.626785 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:45:09.626979 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:45:09.627208 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:45:09.633585 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-85e84b4f-1cb4-492a-b4d0-33bf610d452d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "57cfae71-795b-408e-850f-5293a22274c3" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:09.633880 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-85e84b4f-1cb4-492a-b4d0-33bf610d452d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "57cfae71-795b-408e-850f-5293a22274c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:09.635234 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-85e84b4f-1cb4-492a-b4d0-33bf610d452d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "57cfae71-795b-408e-850f-5293a22274c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:09.635625 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-85e84b4f-1cb4-492a-b4d0-33bf610d452d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "57cfae71-795b-408e-850f-5293a22274c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:09.635819 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-85e84b4f-1cb4-492a-b4d0-33bf610d452d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "57cfae71-795b-408e-850f-5293a22274c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:09.643566 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-85e84b4f-1cb4-492a-b4d0-33bf610d452d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Terminating instance Jun 25 04:45:09.656578 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:44:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1726511870',display_name='tempest-ServerStableDeviceRescueTest-server-1726511870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-serverstabledevicerescuetest-server-1726511870',id=25,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCczQ7zhsEGe+QLQXJg34SvAI2E6UpOulUQ9qoiGJcCUs49y8peCudATDoew2+donLOfJV1jnDRloXe0mGVy24OwyriIMcpjKv5hKMjVr2joIqFN0dwIXsomB46rKYGNxQ==',key_name='tempest-keypair-1676686246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3dcb3dead44d408eb45cdd6509938ff5',ramdisk_id='',reservation_id='r-5dy3c5mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1490129076',owner_user_name='tempest-ServerStableDeviceRescueTest-1490129076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:45:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='623f49d754904441b1a7dda81d8b1621',uuid=81e6cb00-9df3-4ea4-b909-e12184673563,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a5b83b4-d4b0-44a9-944b-00681f7aee0a", "address": "fa:16:3e:f5:86:eb", "network": {"id": "0dc29968-c129-4c9b-b5fa-eae43ec58c07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-650317758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3dcb3dead44d408eb45cdd6509938ff5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5b83b4-d4", "ovs_interfaceid": "6a5b83b4-d4b0-44a9-944b-00681f7aee0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:45:09.657164 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Converting VIF {"id": "6a5b83b4-d4b0-44a9-944b-00681f7aee0a", "address": "fa:16:3e:f5:86:eb", "network": {"id": "0dc29968-c129-4c9b-b5fa-eae43ec58c07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-650317758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3dcb3dead44d408eb45cdd6509938ff5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5b83b4-d4", "ovs_interfaceid": "6a5b83b4-d4b0-44a9-944b-00681f7aee0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:45:09.658806 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:86:eb,bridge_name='br-int',has_traffic_filtering=True,id=6a5b83b4-d4b0-44a9-944b-00681f7aee0a,network=Network(0dc29968-c129-4c9b-b5fa-eae43ec58c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a5b83b4-d4') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:45:09.659255 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Lazy-loading 'pci_devices' on Instance uuid 81e6cb00-9df3-4ea4-b909-e12184673563 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:09.767611 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-c99fa455-44df-4ff3-826e-b4d9664be2ca tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:09.767946 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-c99fa455-44df-4ff3-826e-b4d9664be2ca tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:09.768223 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-c99fa455-44df-4ff3-826e-b4d9664be2ca tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:09.768608 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-c99fa455-44df-4ff3-826e-b4d9664be2ca tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:09.768608 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-c99fa455-44df-4ff3-826e-b4d9664be2ca tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:09.770806 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-c99fa455-44df-4ff3-826e-b4d9664be2ca tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Terminating instance Jun 25 04:45:09.991252 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:10.007668 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:10.025974 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:10.081499 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:10.159814 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-85e84b4f-1cb4-492a-b4d0-33bf610d452d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Start destroying the instance on the hypervisor. {{(pid=98952) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] End _get_guest_xml xml= Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: 81e6cb00-9df3-4ea4-b909-e12184673563 Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: instance-00000019 Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: 196608 Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: tempest-ServerStableDeviceRescueTest-server-1726511870 Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: 2026-06-25 04:45:09 Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: 192 Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: 0 Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: 0 Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: True Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: bare Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: 0 Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: virtio Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: tempest-ServerStableDeviceRescueTest-1490129076-project-member Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: tempest-ServerStableDeviceRescueTest-1490129076 Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: 81e6cb00-9df3-4ea4-b909-e12184673563 Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: 81e6cb00-9df3-4ea4-b909-e12184673563 Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: hvm Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: 128 Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: Jun 25 04:45:10.164393 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:45:10.167925 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Preparing to wait for external event network-vif-plugged-6a5b83b4-d4b0-44a9-944b-00681f7aee0a {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:45:10.167925 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Acquiring lock "81e6cb00-9df3-4ea4-b909-e12184673563-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:10.167925 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Lock "81e6cb00-9df3-4ea4-b909-e12184673563-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:10.167925 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Lock "81e6cb00-9df3-4ea4-b909-e12184673563-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:10.167925 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:44:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1726511870',display_name='tempest-ServerStableDeviceRescueTest-server-1726511870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-serverstabledevicerescuetest-server-1726511870',id=25,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCczQ7zhsEGe+QLQXJg34SvAI2E6UpOulUQ9qoiGJcCUs49y8peCudATDoew2+donLOfJV1jnDRloXe0mGVy24OwyriIMcpjKv5hKMjVr2joIqFN0dwIXsomB46rKYGNxQ==',key_name='tempest-keypair-1676686246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3dcb3dead44d408eb45cdd6509938ff5',ramdisk_id='',reservation_id='r-5dy3c5mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1490129076',owner_user_name='tempest-ServerStableDeviceRescueTest-1490129076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:45:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='623f49d754904441b1a7dda81d8b1621',uuid=81e6cb00-9df3-4ea4-b909-e12184673563,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a5b83b4-d4b0-44a9-944b-00681f7aee0a", "address": "fa:16:3e:f5:86:eb", "network": {"id": "0dc29968-c129-4c9b-b5fa-eae43ec58c07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-650317758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3dcb3dead44d408eb45cdd6509938ff5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5b83b4-d4", "ovs_interfaceid": "6a5b83b4-d4b0-44a9-944b-00681f7aee0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:45:10.167925 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Converting VIF {"id": "6a5b83b4-d4b0-44a9-944b-00681f7aee0a", "address": "fa:16:3e:f5:86:eb", "network": {"id": "0dc29968-c129-4c9b-b5fa-eae43ec58c07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-650317758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3dcb3dead44d408eb45cdd6509938ff5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5b83b4-d4", "ovs_interfaceid": "6a5b83b4-d4b0-44a9-944b-00681f7aee0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:45:10.167925 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:86:eb,bridge_name='br-int',has_traffic_filtering=True,id=6a5b83b4-d4b0-44a9-944b-00681f7aee0a,network=Network(0dc29968-c129-4c9b-b5fa-eae43ec58c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a5b83b4-d4') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:45:10.167925 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:86:eb,bridge_name='br-int',has_traffic_filtering=True,id=6a5b83b4-d4b0-44a9-944b-00681f7aee0a,network=Network(0dc29968-c129-4c9b-b5fa-eae43ec58c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a5b83b4-d4') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:45:10.169238 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:10.169238 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:10.169238 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:45:10.171483 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:10.171483 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81dbdf9d-376b-58c3-af67-5ac2e1803f25', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:10.173142 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:10.173142 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:45:10.187090 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:10.194962 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:10.195448 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a5b83b4-d4, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:10.197139 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a5b83b4-d4, col_values=(('qos', UUID('e1cc305f-e284-4f70-a623-62bcb380e3a6')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:10.197139 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a5b83b4-d4, col_values=(('external_ids', {'iface-id': '6a5b83b4-d4b0-44a9-944b-00681f7aee0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:86:eb', 'vm-uuid': '81e6cb00-9df3-4ea4-b909-e12184673563'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:10.209367 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:10.209367 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:45:10.217828 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:10.225785 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:10.266621 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:10.268380 np0000003587 nova-compute[98952]: INFO os_vif [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:86:eb,bridge_name='br-int',has_traffic_filtering=True,id=6a5b83b4-d4b0-44a9-944b-00681f7aee0a,network=Network(0dc29968-c129-4c9b-b5fa-eae43ec58c07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a5b83b4-d4') Jun 25 04:45:10.276216 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-c99fa455-44df-4ff3-826e-b4d9664be2ca tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Start destroying the instance on the hypervisor. {{(pid=98952) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 25 04:45:10.331143 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:10.337594 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:10.353054 np0000003587 nova-compute[98952]: DEBUG nova.utils [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Queued Task(fn=>, remaining_delay=14.999641757000063 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:10.353054 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.999431077000054 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:10.353054 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.999333324999952 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:10.366718 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:10.369538 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Instance destroyed successfully. Jun 25 04:45:10.369804 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lazy-loading 'numa_topology' on Instance uuid bae4d579-c7f2-4be4-b14b-15bab5381102 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:10.431486 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1693f11b-578b-42f9-b0e8-620f21b68ebb req-bda3f80a-3b12-4275-8bff-f7e715e8e14f service nova] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Received event network-vif-unplugged-d6050276-eeb2-40fb-8897-a9985f54776c {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:10.432256 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1693f11b-578b-42f9-b0e8-620f21b68ebb req-bda3f80a-3b12-4275-8bff-f7e715e8e14f service nova] Acquiring lock "bae4d579-c7f2-4be4-b14b-15bab5381102-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:10.434231 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1693f11b-578b-42f9-b0e8-620f21b68ebb req-bda3f80a-3b12-4275-8bff-f7e715e8e14f service nova] Lock "bae4d579-c7f2-4be4-b14b-15bab5381102-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:10.434570 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1693f11b-578b-42f9-b0e8-620f21b68ebb req-bda3f80a-3b12-4275-8bff-f7e715e8e14f service nova] Lock "bae4d579-c7f2-4be4-b14b-15bab5381102-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:10.434768 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1693f11b-578b-42f9-b0e8-620f21b68ebb req-bda3f80a-3b12-4275-8bff-f7e715e8e14f service nova] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] No waiting events found dispatching network-vif-unplugged-d6050276-eeb2-40fb-8897-a9985f54776c {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:10.434965 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-1693f11b-578b-42f9-b0e8-620f21b68ebb req-bda3f80a-3b12-4275-8bff-f7e715e8e14f service nova] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Received unexpected event network-vif-unplugged-d6050276-eeb2-40fb-8897-a9985f54776c for instance with vm_state active and task_state rescuing. Jun 25 04:45:10.451393 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:10.477981 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:10.509050 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:10.534204 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:10.556874 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:10.616407 np0000003587 nova-compute[98952]: DEBUG nova.utils [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Queued Task(fn=>, remaining_delay=14.999469238000074 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:10.620571 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Instance destroyed successfully. Jun 25 04:45:10.622325 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-85e84b4f-1cb4-492a-b4d0-33bf610d452d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lazy-loading 'resources' on Instance uuid 57cfae71-795b-408e-850f-5293a22274c3 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:10.650343 np0000003587 nova-compute[98952]: DEBUG nova.utils [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Queued Task(fn=>, remaining_delay=14.999720603000014 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:10.652444 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Instance destroyed successfully. Jun 25 04:45:10.653132 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-c99fa455-44df-4ff3-826e-b4d9664be2ca tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lazy-loading 'resources' on Instance uuid d50f4386-5be2-4ba5-b63f-8cca28d53bbd {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:10.882891 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Attempting rescue Jun 25 04:45:10.884174 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98952) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}} Jun 25 04:45:10.895220 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Instance directory exists: not creating {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}} Jun 25 04:45:10.895220 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Creating image(s) Jun 25 04:45:10.896117 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquiring lock "/opt/stack/data/nova/instances/bae4d579-c7f2-4be4-b14b-15bab5381102/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:10.896414 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "/opt/stack/data/nova/instances/bae4d579-c7f2-4be4-b14b-15bab5381102/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:10.897282 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "/opt/stack/data/nova/instances/bae4d579-c7f2-4be4-b14b-15bab5381102/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:10.897436 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lazy-loading 'trusted_certs' on Instance uuid bae4d579-c7f2-4be4-b14b-15bab5381102 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:11.126956 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-85e84b4f-1cb4-492a-b4d0-33bf610d452d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:43:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-28148207-1',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-testmultiattachvolumeswap-server-28148207-1',id=17,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8HNnRKo9IfMu7lIP1nED6tctJTj+M0ERPyvyAQLjV+ZpMZe/o6fnBbF4Wm9oVUurr7j0KLnSjOWjamdd0hVg+0ItnjF/8xHprMSlOVi8pUp6ZbGD1DgwnfSJpWipWzzQ==',key_name='tempest-keypair-974335318',keypairs=,launch_index=0,launched_at=2026-06-25T04:43:49Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='f3904801097947c79fdb5c25d592ac04',ramdisk_id='',reservation_id='r-b6mp0hfb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-726937048',owner_user_name='tempest-TestMultiAttachVolumeSwap-726937048-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:43:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9089e105690144639fa948de817a4f70',uuid=57cfae71-795b-408e-850f-5293a22274c3,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e964866c-f84b-40f3-9766-be7d03de0ccf", "address": "fa:16:3e:cd:9b:6f", "network": {"id": "e6f86cfa-e1c1-4b5f-a202-4fc020faa25c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-929667271-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3904801097947c79fdb5c25d592ac04", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape964866c-f8", "ovs_interfaceid": "e964866c-f84b-40f3-9766-be7d03de0ccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:45:11.127219 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-85e84b4f-1cb4-492a-b4d0-33bf610d452d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Converting VIF {"id": "e964866c-f84b-40f3-9766-be7d03de0ccf", "address": "fa:16:3e:cd:9b:6f", "network": {"id": "e6f86cfa-e1c1-4b5f-a202-4fc020faa25c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-929667271-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3904801097947c79fdb5c25d592ac04", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape964866c-f8", "ovs_interfaceid": "e964866c-f84b-40f3-9766-be7d03de0ccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:45:11.127903 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-85e84b4f-1cb4-492a-b4d0-33bf610d452d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:9b:6f,bridge_name='br-int',has_traffic_filtering=True,id=e964866c-f84b-40f3-9766-be7d03de0ccf,network=Network(e6f86cfa-e1c1-4b5f-a202-4fc020faa25c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape964866c-f8') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:45:11.128125 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-85e84b4f-1cb4-492a-b4d0-33bf610d452d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:9b:6f,bridge_name='br-int',has_traffic_filtering=True,id=e964866c-f84b-40f3-9766-be7d03de0ccf,network=Network(e6f86cfa-e1c1-4b5f-a202-4fc020faa25c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape964866c-f8') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:45:11.129955 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:11.130214 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape964866c-f8, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:11.133051 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:45:11.153704 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:11.155003 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:11.155250 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a41791d9-d471-4fdd-b57c-12c67e5a8631) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:11.156968 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-c99fa455-44df-4ff3-826e-b4d9664be2ca tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:43:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-28148207-2',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-testmultiattachvolumeswap-server-28148207-2',id=18,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8HNnRKo9IfMu7lIP1nED6tctJTj+M0ERPyvyAQLjV+ZpMZe/o6fnBbF4Wm9oVUurr7j0KLnSjOWjamdd0hVg+0ItnjF/8xHprMSlOVi8pUp6ZbGD1DgwnfSJpWipWzzQ==',key_name='tempest-keypair-974335318',keypairs=,launch_index=1,launched_at=2026-06-25T04:43:56Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='f3904801097947c79fdb5c25d592ac04',ramdisk_id='',reservation_id='r-b6mp0hfb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-726937048',owner_user_name='tempest-TestMultiAttachVolumeSwap-726937048-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:43:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9089e105690144639fa948de817a4f70',uuid=d50f4386-5be2-4ba5-b63f-8cca28d53bbd,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1dad6b2-03a7-4440-a485-a06ce1cc0802", "address": "fa:16:3e:48:68:a7", "network": {"id": "e6f86cfa-e1c1-4b5f-a202-4fc020faa25c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-929667271-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3904801097947c79fdb5c25d592ac04", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1dad6b2-03", "ovs_interfaceid": "b1dad6b2-03a7-4440-a485-a06ce1cc0802", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:45:11.157287 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:11.157482 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-c99fa455-44df-4ff3-826e-b4d9664be2ca tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Converting VIF {"id": "b1dad6b2-03a7-4440-a485-a06ce1cc0802", "address": "fa:16:3e:48:68:a7", "network": {"id": "e6f86cfa-e1c1-4b5f-a202-4fc020faa25c", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-929667271-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f3904801097947c79fdb5c25d592ac04", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1dad6b2-03", "ovs_interfaceid": "b1dad6b2-03a7-4440-a485-a06ce1cc0802", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:45:11.158673 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:45:11.159125 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-c99fa455-44df-4ff3-826e-b4d9664be2ca tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:68:a7,bridge_name='br-int',has_traffic_filtering=True,id=b1dad6b2-03a7-4440-a485-a06ce1cc0802,network=Network(e6f86cfa-e1c1-4b5f-a202-4fc020faa25c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1dad6b2-03') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:45:11.160210 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-c99fa455-44df-4ff3-826e-b4d9664be2ca tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:68:a7,bridge_name='br-int',has_traffic_filtering=True,id=b1dad6b2-03a7-4440-a485-a06ce1cc0802,network=Network(e6f86cfa-e1c1-4b5f-a202-4fc020faa25c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1dad6b2-03') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:45:11.175099 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:11.175971 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:11.177171 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1dad6b2-03, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:11.178411 np0000003587 nova-compute[98952]: INFO os_vif [None req-85e84b4f-1cb4-492a-b4d0-33bf610d452d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:9b:6f,bridge_name='br-int',has_traffic_filtering=True,id=e964866c-f84b-40f3-9766-be7d03de0ccf,network=Network(e6f86cfa-e1c1-4b5f-a202-4fc020faa25c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape964866c-f8') Jun 25 04:45:11.180095 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:45:11.180850 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-85e84b4f-1cb4-492a-b4d0-33bf610d452d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Deleting instance files /opt/stack/data/nova/instances/57cfae71-795b-408e-850f-5293a22274c3_del Jun 25 04:45:11.182394 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-85e84b4f-1cb4-492a-b4d0-33bf610d452d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Deletion of /opt/stack/data/nova/instances/57cfae71-795b-408e-850f-5293a22274c3_del complete Jun 25 04:45:11.191725 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:11.193446 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:11.193685 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86c304c8-12ec-477e-b43e-57a3f95599cc) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:11.195076 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:11.195752 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:45:11.207874 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:11.210240 np0000003587 nova-compute[98952]: INFO os_vif [None req-c99fa455-44df-4ff3-826e-b4d9664be2ca tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:68:a7,bridge_name='br-int',has_traffic_filtering=True,id=b1dad6b2-03a7-4440-a485-a06ce1cc0802,network=Network(e6f86cfa-e1c1-4b5f-a202-4fc020faa25c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1dad6b2-03') Jun 25 04:45:11.211325 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-c99fa455-44df-4ff3-826e-b4d9664be2ca tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Deleting instance files /opt/stack/data/nova/instances/d50f4386-5be2-4ba5-b63f-8cca28d53bbd_del Jun 25 04:45:11.212204 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-c99fa455-44df-4ff3-826e-b4d9664be2ca tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Deletion of /opt/stack/data/nova/instances/d50f4386-5be2-4ba5-b63f-8cca28d53bbd_del complete Jun 25 04:45:11.401745 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:45:11.402270 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:45:11.406519 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:45:11.406519 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquiring lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:11.406519 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:11.407370 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:45:11.409750 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:45:11.410249 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:11.528300 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.118s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:11.529174 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/bae4d579-c7f2-4be4-b14b-15bab5381102/disk.rescue {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:11.600811 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/bae4d579-c7f2-4be4-b14b-15bab5381102/disk.rescue" returned: 0 in 0.071s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:11.601296 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.195s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:11.601714 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lazy-loading 'migration_context' on Instance uuid bae4d579-c7f2-4be4-b14b-15bab5381102 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:11.698035 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-85e84b4f-1cb4-492a-b4d0-33bf610d452d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Took 1.54 seconds to destroy the instance on the hypervisor. Jun 25 04:45:11.700433 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._common.loopingcall [None req-85e84b4f-1cb4-492a-b4d0-33bf610d452d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98952) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 25 04:45:11.700433 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [-] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Deallocating network for instance {{(pid=98952) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 25 04:45:11.701889 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: 57cfae71-795b-408e-850f-5293a22274c3] deallocate_for_instance() {{(pid=98952) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 25 04:45:11.702597 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:11.726523 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-c99fa455-44df-4ff3-826e-b4d9664be2ca tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Took 1.45 seconds to destroy the instance on the hypervisor. Jun 25 04:45:11.727035 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._common.loopingcall [None req-c99fa455-44df-4ff3-826e-b4d9664be2ca tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98952) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 25 04:45:11.727315 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [-] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Deallocating network for instance {{(pid=98952) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 25 04:45:11.727315 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] deallocate_for_instance() {{(pid=98952) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 25 04:45:11.727804 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:11.794431 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:11.798962 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:45:11.799131 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:45:11.799289 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] No VIF found with MAC fa:16:3e:f5:86:eb, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:45:11.800004 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Using config drive Jun 25 04:45:11.843819 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:11.867789 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:12.104726 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:45:12.104887 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Created local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 25 04:45:12.105441 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Start _get_guest_xml network_info=[{"id": "d6050276-eeb2-40fb-8897-a9985f54776c", "address": "fa:16:3e:32:f4:b4", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "vif_mac": "fa:16:3e:32:f4:b4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6050276-ee", "ovs_interfaceid": "d6050276-eeb2-40fb-8897-a9985f54776c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue={'image_id': '4ecaf199-c1b9-4ce3-869c-178c170c1662', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:45:12.105669 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lazy-loading 'resources' on Instance uuid bae4d579-c7f2-4be4-b14b-15bab5381102 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:12.308322 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:12.319136 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d0566a25-ad03-4daa-a06b-563e3dcebd8f req-9131d513-8201-4dba-becd-30a5f07c2a18 service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Received event network-vif-deleted-b1dad6b2-03a7-4440-a485-a06ce1cc0802 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:12.319333 np0000003587 nova-compute[98952]: INFO nova.compute.manager [req-d0566a25-ad03-4daa-a06b-563e3dcebd8f req-9131d513-8201-4dba-becd-30a5f07c2a18 service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Neutron deleted interface b1dad6b2-03a7-4440-a485-a06ce1cc0802; detaching it from the instance and deleting it from the info cache Jun 25 04:45:12.322598 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d0566a25-ad03-4daa-a06b-563e3dcebd8f req-9131d513-8201-4dba-becd-30a5f07c2a18 service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Detach interface failed, port_id=b1dad6b2-03a7-4440-a485-a06ce1cc0802, reason: Instance d50f4386-5be2-4ba5-b63f-8cca28d53bbd could not be found. {{(pid=98952) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 25 04:45:12.369878 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-daa746aa-be50-44d0-aa3a-39c26a02fc4d req-15cd94f2-8195-41ed-aa6c-5bf68cf6f0d4 service nova] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Received event network-vif-deleted-e964866c-f84b-40f3-9766-be7d03de0ccf {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:12.370705 np0000003587 nova-compute[98952]: INFO nova.compute.manager [req-daa746aa-be50-44d0-aa3a-39c26a02fc4d req-15cd94f2-8195-41ed-aa6c-5bf68cf6f0d4 service nova] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Neutron deleted interface e964866c-f84b-40f3-9766-be7d03de0ccf; detaching it from the instance and deleting it from the info cache Jun 25 04:45:12.372172 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-daa746aa-be50-44d0-aa3a-39c26a02fc4d req-15cd94f2-8195-41ed-aa6c-5bf68cf6f0d4 service nova] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Detach interface failed, port_id=e964866c-f84b-40f3-9766-be7d03de0ccf, reason: Instance 57cfae71-795b-408e-850f-5293a22274c3 could not be found. {{(pid=98952) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 25 04:45:12.470526 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Creating config drive at /opt/stack/data/nova/instances/81e6cb00-9df3-4ea4-b909-e12184673563/disk.config Jun 25 04:45:12.475548 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/81e6cb00-9df3-4ea4-b909-e12184673563/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7l07fue7 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:12.532050 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/81e6cb00-9df3-4ea4-b909-e12184673563/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7l07fue7" returned: 0 in 0.057s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:12.557645 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Received event network-vif-unplugged-d6050276-eeb2-40fb-8897-a9985f54776c {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:12.558890 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] Acquiring lock "bae4d579-c7f2-4be4-b14b-15bab5381102-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:12.559110 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] Lock "bae4d579-c7f2-4be4-b14b-15bab5381102-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:12.559236 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] Lock "bae4d579-c7f2-4be4-b14b-15bab5381102-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:12.559424 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] No waiting events found dispatching network-vif-unplugged-d6050276-eeb2-40fb-8897-a9985f54776c {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:12.559668 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Received unexpected event network-vif-unplugged-d6050276-eeb2-40fb-8897-a9985f54776c for instance with vm_state active and task_state rescuing. Jun 25 04:45:12.559789 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Received event network-vif-unplugged-e964866c-f84b-40f3-9766-be7d03de0ccf {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:12.560022 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] Acquiring lock "57cfae71-795b-408e-850f-5293a22274c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:12.560479 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] Lock "57cfae71-795b-408e-850f-5293a22274c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:12.560648 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] Lock "57cfae71-795b-408e-850f-5293a22274c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:12.560773 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] [instance: 57cfae71-795b-408e-850f-5293a22274c3] No waiting events found dispatching network-vif-unplugged-e964866c-f84b-40f3-9766-be7d03de0ccf {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:12.560909 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Received event network-vif-unplugged-e964866c-f84b-40f3-9766-be7d03de0ccf for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:45:12.561056 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Received event network-vif-unplugged-e964866c-f84b-40f3-9766-be7d03de0ccf {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:12.561173 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] Acquiring lock "57cfae71-795b-408e-850f-5293a22274c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:12.561296 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] Lock "57cfae71-795b-408e-850f-5293a22274c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:12.561391 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] Lock "57cfae71-795b-408e-850f-5293a22274c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:12.561526 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] [instance: 57cfae71-795b-408e-850f-5293a22274c3] No waiting events found dispatching network-vif-unplugged-e964866c-f84b-40f3-9766-be7d03de0ccf {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:12.561654 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Received event network-vif-unplugged-e964866c-f84b-40f3-9766-be7d03de0ccf for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:45:12.561767 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Received event network-vif-unplugged-b1dad6b2-03a7-4440-a485-a06ce1cc0802 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:12.561896 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] Acquiring lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:12.563086 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] Lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:12.563248 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] Lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:12.563862 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] No waiting events found dispatching network-vif-unplugged-b1dad6b2-03a7-4440-a485-a06ce1cc0802 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:12.563975 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Received event network-vif-unplugged-b1dad6b2-03a7-4440-a485-a06ce1cc0802 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:45:12.564150 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Received event network-vif-unplugged-b1dad6b2-03a7-4440-a485-a06ce1cc0802 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:12.564342 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] Acquiring lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:12.564596 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] Lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:12.564755 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] Lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:12.564890 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] No waiting events found dispatching network-vif-unplugged-b1dad6b2-03a7-4440-a485-a06ce1cc0802 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:12.564999 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8d5adbea-644f-4a11-98ef-e729275e64d0 req-9e64bf10-df6b-46f1-b595-49f79c9ebe9c service nova] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Received event network-vif-unplugged-b1dad6b2-03a7-4440-a485-a06ce1cc0802 for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:45:12.608180 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:45:12.612413 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:45:12.614673 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-809981806', uuid='bae4d579-c7f2-4be4-b14b-15bab5381102'), owner=OwnerMeta(userid='ecbe28912a3b48e2b7c9023b1615e0cc', username='tempest-ServerRescueNegativeTestJSON-1184161043-project-member', projectid='8c14752bebb0420a9c82e4049038bcc3', projectname='tempest-ServerRescueNegativeTestJSON-1184161043'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d6050276-eeb2-40fb-8897-a9985f54776c", "address": "fa:16:3e:32:f4:b4", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "vif_mac": "fa:16:3e:32:f4:b4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6050276-ee", "ovs_interfaceid": "d6050276-eeb2-40fb-8897-a9985f54776c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362712.6138396) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:45:12.616276 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:45:12.616830 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:45:12.619094 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:45:12.619334 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:45:12.620524 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:45:12.620994 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:45:12.621107 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:45:12.621234 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:45:12.621342 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:45:12.621525 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:45:12.621626 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:45:12.621816 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:45:12.622104 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:45:12.622104 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:45:12.622211 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:45:12.622386 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:45:12.622665 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lazy-loading 'vcpu_model' on Instance uuid bae4d579-c7f2-4be4-b14b-15bab5381102 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:12.715300 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:45:12.823501 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:45:13.038712 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:13.077793 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:13.081668 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:13.124949 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:45:13.142244 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-809981806',display_name='tempest-ServerRescueNegativeTestJSON-server-809981806',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-serverrescuenegativetestjson-server-809981806',id=24,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-25T04:45:05Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8c14752bebb0420a9c82e4049038bcc3',ramdisk_id='',reservation_id='r-okzmxzn3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1184161043',owner_user_name='tempest-ServerRescueNegativeTestJSON-1184161043-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:45:05Z,user_data=None,user_id='ecbe28912a3b48e2b7c9023b1615e0cc',uuid=bae4d579-c7f2-4be4-b14b-15bab5381102,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6050276-eeb2-40fb-8897-a9985f54776c", "address": "fa:16:3e:32:f4:b4", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "vif_mac": "fa:16:3e:32:f4:b4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6050276-ee", "ovs_interfaceid": "d6050276-eeb2-40fb-8897-a9985f54776c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:45:13.142668 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Converting VIF {"id": "d6050276-eeb2-40fb-8897-a9985f54776c", "address": "fa:16:3e:32:f4:b4", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "vif_mac": "fa:16:3e:32:f4:b4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6050276-ee", "ovs_interfaceid": "d6050276-eeb2-40fb-8897-a9985f54776c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:45:13.143692 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:f4:b4,bridge_name='br-int',has_traffic_filtering=True,id=d6050276-eeb2-40fb-8897-a9985f54776c,network=Network(06c0ad47-4541-470f-826b-31e1b541d27e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6050276-ee') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:45:13.144683 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lazy-loading 'pci_devices' on Instance uuid bae4d579-c7f2-4be4-b14b-15bab5381102 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:13.174837 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:13.218129 np0000003587 nova-compute[98952]: INFO nova.compute.manager [-] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Took 1.49 seconds to deallocate network for instance. Jun 25 04:45:13.329432 np0000003587 nova-compute[98952]: INFO nova.compute.manager [-] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Took 1.63 seconds to deallocate network for instance. Jun 25 04:45:13.536868 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:13.547011 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:13.551732 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:13.581829 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:13.594606 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:13.647017 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] End _get_guest_xml xml= Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: bae4d579-c7f2-4be4-b14b-15bab5381102 Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: instance-00000018 Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: 196608 Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: tempest-ServerRescueNegativeTestJSON-server-809981806 Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: 2026-06-25 04:45:12 Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: 192 Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: 0 Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: 0 Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: True Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: bare Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: 0 Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: ide Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: virtio Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: pc Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: virtio Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: virtio Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: virtio Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: tempest-ServerRescueNegativeTestJSON-1184161043-project-member Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: tempest-ServerRescueNegativeTestJSON-1184161043 Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: bae4d579-c7f2-4be4-b14b-15bab5381102 Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: bae4d579-c7f2-4be4-b14b-15bab5381102 Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: hvm Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: 128 Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: Jun 25 04:45:13.648184 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:45:13.668360 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Instance destroyed successfully. Jun 25 04:45:13.726217 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-c99fa455-44df-4ff3-826e-b4d9664be2ca tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:13.726217 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-c99fa455-44df-4ff3-826e-b4d9664be2ca tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:13.844996 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-85e84b4f-1cb4-492a-b4d0-33bf610d452d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:14.260592 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:45:14.260592 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] VM Started (Lifecycle Event) Jun 25 04:45:14.443151 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-9726fe8c-0c69-4309-8b5e-4ffbe384d5b3 req-0f1a17f4-294f-45e9-b7ea-b7b25bddbfa9 service nova] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Received event network-vif-plugged-6a5b83b4-d4b0-44a9-944b-00681f7aee0a {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:14.443709 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-9726fe8c-0c69-4309-8b5e-4ffbe384d5b3 req-0f1a17f4-294f-45e9-b7ea-b7b25bddbfa9 service nova] Acquiring lock "81e6cb00-9df3-4ea4-b909-e12184673563-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:14.443867 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-9726fe8c-0c69-4309-8b5e-4ffbe384d5b3 req-0f1a17f4-294f-45e9-b7ea-b7b25bddbfa9 service nova] Lock "81e6cb00-9df3-4ea4-b909-e12184673563-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:14.444095 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-9726fe8c-0c69-4309-8b5e-4ffbe384d5b3 req-0f1a17f4-294f-45e9-b7ea-b7b25bddbfa9 service nova] Lock "81e6cb00-9df3-4ea4-b909-e12184673563-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:14.444305 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-9726fe8c-0c69-4309-8b5e-4ffbe384d5b3 req-0f1a17f4-294f-45e9-b7ea-b7b25bddbfa9 service nova] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Processing event network-vif-plugged-6a5b83b4-d4b0-44a9-944b-00681f7aee0a {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:45:14.444346 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-9726fe8c-0c69-4309-8b5e-4ffbe384d5b3 req-0f1a17f4-294f-45e9-b7ea-b7b25bddbfa9 service nova] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Received event network-vif-plugged-6a5b83b4-d4b0-44a9-944b-00681f7aee0a {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:14.444488 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-9726fe8c-0c69-4309-8b5e-4ffbe384d5b3 req-0f1a17f4-294f-45e9-b7ea-b7b25bddbfa9 service nova] Acquiring lock "81e6cb00-9df3-4ea4-b909-e12184673563-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:14.444664 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-9726fe8c-0c69-4309-8b5e-4ffbe384d5b3 req-0f1a17f4-294f-45e9-b7ea-b7b25bddbfa9 service nova] Lock "81e6cb00-9df3-4ea4-b909-e12184673563-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:14.444759 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-9726fe8c-0c69-4309-8b5e-4ffbe384d5b3 req-0f1a17f4-294f-45e9-b7ea-b7b25bddbfa9 service nova] Lock "81e6cb00-9df3-4ea4-b909-e12184673563-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:14.444863 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-9726fe8c-0c69-4309-8b5e-4ffbe384d5b3 req-0f1a17f4-294f-45e9-b7ea-b7b25bddbfa9 service nova] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] No waiting events found dispatching network-vif-plugged-6a5b83b4-d4b0-44a9-944b-00681f7aee0a {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:14.444970 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-9726fe8c-0c69-4309-8b5e-4ffbe384d5b3 req-0f1a17f4-294f-45e9-b7ea-b7b25bddbfa9 service nova] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Received unexpected event network-vif-plugged-6a5b83b4-d4b0-44a9-944b-00681f7aee0a for instance with vm_state building and task_state spawning. Jun 25 04:45:14.445578 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:45:14.451728 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Guest created on hypervisor {{(pid=98952) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 25 04:45:14.454635 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Instance spawned successfully. Jun 25 04:45:14.454928 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 25 04:45:14.572250 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-c99fa455-44df-4ff3-826e-b4d9664be2ca tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:45:14.573282 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-c99fa455-44df-4ff3-826e-b4d9664be2ca tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:45:14.694342 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:14.762428 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:14.764435 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:45:14.967766 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Found default for hw_cdrom_bus of ide {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:45:14.967766 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Found default for hw_disk_bus of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:45:14.968295 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Found default for hw_input_bus of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:45:14.968295 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Found default for hw_pointer_model of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:45:14.969044 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Found default for hw_video_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:45:14.969044 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Found default for hw_vif_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:45:15.027659 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:15.078989 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-c99fa455-44df-4ff3-826e-b4d9664be2ca tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:45:15.200044 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:45:15.200195 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:45:15.200336 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:45:15.200500 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] No VIF found with MAC fa:16:3e:32:f4:b4, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:45:15.201199 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Using config drive Jun 25 04:45:15.267253 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] During sync_power_state the instance has a pending task (spawning). Skip. Jun 25 04:45:15.267630 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Paused> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:45:15.267849 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] VM Paused (Lifecycle Event) Jun 25 04:45:15.474255 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Took 8.57 seconds to spawn the instance on the hypervisor. Jun 25 04:45:15.476857 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:15.596680 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-c99fa455-44df-4ff3-826e-b4d9664be2ca tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.870s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:15.602200 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-85e84b4f-1cb4-492a-b4d0-33bf610d452d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.752s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:15.707050 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lazy-loading 'ec2_ids' on Instance uuid bae4d579-c7f2-4be4-b14b-15bab5381102 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:15.733079 np0000003587 nova-compute[98952]: INFO nova.scheduler.client.report [None req-c99fa455-44df-4ff3-826e-b4d9664be2ca tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Deleted allocations for instance d50f4386-5be2-4ba5-b63f-8cca28d53bbd Jun 25 04:45:15.773796 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:15.776884 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:45:15.776884 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] VM Resumed (Lifecycle Event) Jun 25 04:45:15.990020 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Took 19.21 seconds to build instance. Jun 25 04:45:16.195782 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:16.211097 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:45:16.211304 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lazy-loading 'keypairs' on Instance uuid bae4d579-c7f2-4be4-b14b-15bab5381102 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:16.280578 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:16.284879 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:45:16.460374 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-85e84b4f-1cb4-492a-b4d0-33bf610d452d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:45:16.460775 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-85e84b4f-1cb4-492a-b4d0-33bf610d452d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:45:16.491915 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-e0840356-2fcd-4f67-9712-ba6b9aeb13c9 tempest-ServerStableDeviceRescueTest-1490129076 tempest-ServerStableDeviceRescueTest-1490129076-project-member] Lock "81e6cb00-9df3-4ea4-b909-e12184673563" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 20.738s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:16.715825 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:45:16.719612 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:16.744144 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-c99fa455-44df-4ff3-826e-b4d9664be2ca tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "d50f4386-5be2-4ba5-b63f-8cca28d53bbd" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.976s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:16.924109 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Creating config drive at /opt/stack/data/nova/instances/bae4d579-c7f2-4be4-b14b-15bab5381102/disk.config.rescue Jun 25 04:45:16.927678 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bae4d579-c7f2-4be4-b14b-15bab5381102/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpy6i7g960 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:16.965694 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-85e84b4f-1cb4-492a-b4d0-33bf610d452d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:45:16.988625 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bae4d579-c7f2-4be4-b14b-15bab5381102/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpy6i7g960" returned: 0 in 0.060s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:17.479579 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-85e84b4f-1cb4-492a-b4d0-33bf610d452d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.882s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:17.554493 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:17.584322 np0000003587 nova-compute[98952]: INFO nova.scheduler.client.report [None req-85e84b4f-1cb4-492a-b4d0-33bf610d452d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Deleted allocations for instance 57cfae71-795b-408e-850f-5293a22274c3 Jun 25 04:45:17.594493 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:17.707132 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:17.773897 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:17.774946 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:17.885840 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1ffeb676-45f6-4b58-b7b3-2aa26c57a6ac req-7d7fab69-345d-4f84-b0ca-0d8fea486b3c service nova] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Received event network-vif-plugged-d6050276-eeb2-40fb-8897-a9985f54776c {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:17.886741 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1ffeb676-45f6-4b58-b7b3-2aa26c57a6ac req-7d7fab69-345d-4f84-b0ca-0d8fea486b3c service nova] Acquiring lock "bae4d579-c7f2-4be4-b14b-15bab5381102-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:17.887015 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1ffeb676-45f6-4b58-b7b3-2aa26c57a6ac req-7d7fab69-345d-4f84-b0ca-0d8fea486b3c service nova] Lock "bae4d579-c7f2-4be4-b14b-15bab5381102-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:17.887270 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-1ffeb676-45f6-4b58-b7b3-2aa26c57a6ac req-7d7fab69-345d-4f84-b0ca-0d8fea486b3c service nova] Lock "bae4d579-c7f2-4be4-b14b-15bab5381102-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:17.887547 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-1ffeb676-45f6-4b58-b7b3-2aa26c57a6ac req-7d7fab69-345d-4f84-b0ca-0d8fea486b3c service nova] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] No waiting events found dispatching network-vif-plugged-d6050276-eeb2-40fb-8897-a9985f54776c {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:17.887684 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-1ffeb676-45f6-4b58-b7b3-2aa26c57a6ac req-7d7fab69-345d-4f84-b0ca-0d8fea486b3c service nova] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Received unexpected event network-vif-plugged-d6050276-eeb2-40fb-8897-a9985f54776c for instance with vm_state active and task_state rescuing. Jun 25 04:45:18.247969 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8c4eda5c-80fe-4470-a36a-8bb7a8449048 req-d708bd85-a30b-4caa-abbd-4d705e801d2c service nova] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Received event network-changed-6a5b83b4-d4b0-44a9-944b-00681f7aee0a {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:18.251172 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-8c4eda5c-80fe-4470-a36a-8bb7a8449048 req-d708bd85-a30b-4caa-abbd-4d705e801d2c service nova] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Refreshing instance network info cache due to event network-changed-6a5b83b4-d4b0-44a9-944b-00681f7aee0a. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:45:18.251172 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8c4eda5c-80fe-4470-a36a-8bb7a8449048 req-d708bd85-a30b-4caa-abbd-4d705e801d2c service nova] Acquiring lock "refresh_cache-81e6cb00-9df3-4ea4-b909-e12184673563" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:45:18.251172 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8c4eda5c-80fe-4470-a36a-8bb7a8449048 req-d708bd85-a30b-4caa-abbd-4d705e801d2c service nova] Acquired lock "refresh_cache-81e6cb00-9df3-4ea4-b909-e12184673563" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:45:18.251172 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-8c4eda5c-80fe-4470-a36a-8bb7a8449048 req-d708bd85-a30b-4caa-abbd-4d705e801d2c service nova] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Refreshing network info cache for port 6a5b83b4-d4b0-44a9-944b-00681f7aee0a {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:45:18.601635 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-85e84b4f-1cb4-492a-b4d0-33bf610d452d tempest-TestMultiAttachVolumeSwap-726937048 tempest-TestMultiAttachVolumeSwap-726937048-project-member] Lock "57cfae71-795b-408e-850f-5293a22274c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.968s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:18.728023 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Removed pending STOPPED event for bae4d579-c7f2-4be4-b14b-15bab5381102 due to new event Resumed> {{(pid=98952) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 25 04:45:18.728356 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:45:18.728356 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] VM Resumed (Lifecycle Event) Jun 25 04:45:18.736186 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-b673fc9d-391f-406f-a4f0-cf574ef91cad tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:18.758610 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-8c4eda5c-80fe-4470-a36a-8bb7a8449048 req-d708bd85-a30b-4caa-abbd-4d705e801d2c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:19.231600 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-8c4eda5c-80fe-4470-a36a-8bb7a8449048 req-d708bd85-a30b-4caa-abbd-4d705e801d2c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:19.234581 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:19.241913 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:45:19.418998 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-8c4eda5c-80fe-4470-a36a-8bb7a8449048 req-d708bd85-a30b-4caa-abbd-4d705e801d2c service nova] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Updated VIF entry in instance network info cache for port 6a5b83b4-d4b0-44a9-944b-00681f7aee0a. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:45:19.419315 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-8c4eda5c-80fe-4470-a36a-8bb7a8449048 req-d708bd85-a30b-4caa-abbd-4d705e801d2c service nova] [instance: 81e6cb00-9df3-4ea4-b909-e12184673563] Updating instance_info_cache with network_info: [{"id": "6a5b83b4-d4b0-44a9-944b-00681f7aee0a", "address": "fa:16:3e:f5:86:eb", "network": {"id": "0dc29968-c129-4c9b-b5fa-eae43ec58c07", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-650317758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3dcb3dead44d408eb45cdd6509938ff5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5b83b4-d4", "ovs_interfaceid": "6a5b83b4-d4b0-44a9-944b-00681f7aee0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:45:19.749273 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:45:19.749273 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] VM Started (Lifecycle Event) Jun 25 04:45:19.922277 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-8c4eda5c-80fe-4470-a36a-8bb7a8449048 req-d708bd85-a30b-4caa-abbd-4d705e801d2c service nova] Releasing lock "refresh_cache-81e6cb00-9df3-4ea4-b909-e12184673563" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:45:19.987950 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-a7ae36d4-5337-40fb-b4df-30b333a180ac req-cebe5373-0c44-4d2b-bf6e-5c7a172eb55b service nova] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Received event network-vif-plugged-d6050276-eeb2-40fb-8897-a9985f54776c {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:19.988400 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a7ae36d4-5337-40fb-b4df-30b333a180ac req-cebe5373-0c44-4d2b-bf6e-5c7a172eb55b service nova] Acquiring lock "bae4d579-c7f2-4be4-b14b-15bab5381102-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:19.989340 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a7ae36d4-5337-40fb-b4df-30b333a180ac req-cebe5373-0c44-4d2b-bf6e-5c7a172eb55b service nova] Lock "bae4d579-c7f2-4be4-b14b-15bab5381102-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:19.989340 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a7ae36d4-5337-40fb-b4df-30b333a180ac req-cebe5373-0c44-4d2b-bf6e-5c7a172eb55b service nova] Lock "bae4d579-c7f2-4be4-b14b-15bab5381102-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:19.989340 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-a7ae36d4-5337-40fb-b4df-30b333a180ac req-cebe5373-0c44-4d2b-bf6e-5c7a172eb55b service nova] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] No waiting events found dispatching network-vif-plugged-d6050276-eeb2-40fb-8897-a9985f54776c {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:19.989340 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-a7ae36d4-5337-40fb-b4df-30b333a180ac req-cebe5373-0c44-4d2b-bf6e-5c7a172eb55b service nova] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Received unexpected event network-vif-plugged-d6050276-eeb2-40fb-8897-a9985f54776c for instance with vm_state rescued and task_state None. Jun 25 04:45:20.031628 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:20.254014 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:20.255816 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: bae4d579-c7f2-4be4-b14b-15bab5381102] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:45:20.708706 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:21.197456 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:21.970003 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Rescuing Jun 25 04:45:21.970255 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquiring lock "refresh_cache-e6afb3ec-b48f-4dd6-95a1-d3c097b5203c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:45:21.970423 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquired lock "refresh_cache-e6afb3ec-b48f-4dd6-95a1-d3c097b5203c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:45:21.970627 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:45:22.265276 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Stashing vm_state: active {{(pid=98952) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}} Jun 25 04:45:22.472955 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:22.778319 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:22.874112 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Acquiring lock "interface-d0e9b114-f17b-4b1e-b8e1-b1a821f38974-None" by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:22.874295 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "interface-d0e9b114-f17b-4b1e-b8e1-b1a821f38974-None" acquired by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:22.874798 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lazy-loading 'flavor' on Instance uuid d0e9b114-f17b-4b1e-b8e1-b1a821f38974 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:22.878821 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:22.879379 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:22.921152 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:23.093461 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Updating instance_info_cache with network_info: [{"id": "4a601377-1147-4c58-9ff9-5fb6c1610844", "address": "fa:16:3e:59:7d:cd", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a601377-11", "ovs_interfaceid": "4a601377-1147-4c58-9ff9-5fb6c1610844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:45:23.382158 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:23.391884 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:45:23.392414 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Claim successful on node np0000003587 Jun 25 04:45:23.596536 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Releasing lock "refresh_cache-e6afb3ec-b48f-4dd6-95a1-d3c097b5203c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:45:23.647356 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lazy-loading 'pci_requests' on Instance uuid d0e9b114-f17b-4b1e-b8e1-b1a821f38974 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:23.899505 np0000003587 nova-compute[98952]: INFO nova.compute.resource_tracker [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Updating resource usage from migration 00a748b8-ecb0-46a6-adaf-d7ef9a9b1e57 Jun 25 04:45:24.153584 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Object Instance lazy-loaded attributes: flavor,pci_requests {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:45:24.153584 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:45:24.153584 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:24.153584 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:24.289353 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5da5f5d0548e4d11b82042832880176d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '394c4d7e8a6f4b7e8fbefeb88f1f4022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:45:24.399077 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:25.517401 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:45:25.517401 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:45:25.517401 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Successfully created port: af0911e1-6cbd-42bf-aef4-7003f4f4e730 {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:45:25.517401 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:25.517401 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:45:25.517401 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:25.517401 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:25.517401 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:25.517401 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.004327327000055448 future=) was cancelled during its delay period, skipping {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:25.517401 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:25.517401 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.2593380470000284 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:25.517401 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=0.2591965540000274 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:25.546487 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:25.552065 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:25.616427 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00047896299997773895 future=) submitted to {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:25.616427 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:25.616814 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.033344536999948104 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:25.616918 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=0.03321212199989532 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:25.617877 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Emitting event Stopped> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:45:25.618074 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] VM Stopped (Lifecycle Event) Jun 25 04:45:25.649110 np0000003587 nova-compute[98952]: DEBUG nova.utils [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Queued Task(fn=>, remaining_delay=14.999677652999935 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:25.650532 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004461779999473947 future=) submitted to {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:25.650901 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:25.654006 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Emitting event Stopped> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:45:25.654006 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] VM Stopped (Lifecycle Event) Jun 25 04:45:25.657001 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.99286520999999 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:25.657231 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.99146325400011 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:25.663629 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Instance destroyed successfully. Jun 25 04:45:25.664825 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lazy-loading 'numa_topology' on Instance uuid e6afb3ec-b48f-4dd6-95a1-d3c097b5203c {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:25.799229 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.919s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:25.799846 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Migrating Jun 25 04:45:25.800099 np0000003587 nova-compute[98952]: DEBUG nova.compute.rpcapi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98952) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 25 04:45:25.848517 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Successfully updated port: af0911e1-6cbd-42bf-aef4-7003f4f4e730 {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:45:25.935545 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-56748a86-1c57-4d93-ade5-255e917c3e68 req-d58175cb-215e-4d8c-9768-b2bcf67227ed service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Received event network-changed-af0911e1-6cbd-42bf-aef4-7003f4f4e730 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:25.935545 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-56748a86-1c57-4d93-ade5-255e917c3e68 req-d58175cb-215e-4d8c-9768-b2bcf67227ed service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Refreshing instance network info cache due to event network-changed-af0911e1-6cbd-42bf-aef4-7003f4f4e730. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:45:25.935545 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-56748a86-1c57-4d93-ade5-255e917c3e68 req-d58175cb-215e-4d8c-9768-b2bcf67227ed service nova] Acquiring lock "refresh_cache-d0e9b114-f17b-4b1e-b8e1-b1a821f38974" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:45:25.935545 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-56748a86-1c57-4d93-ade5-255e917c3e68 req-d58175cb-215e-4d8c-9768-b2bcf67227ed service nova] Acquired lock "refresh_cache-d0e9b114-f17b-4b1e-b8e1-b1a821f38974" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:45:25.935545 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-56748a86-1c57-4d93-ade5-255e917c3e68 req-d58175cb-215e-4d8c-9768-b2bcf67227ed service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Refreshing network info cache for port af0911e1-6cbd-42bf-aef4-7003f4f4e730 {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:45:26.176404 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-3db299bd-5bd0-4698-b277-ce68f24b9066 req-e6e386b3-9271-4c16-a687-6680ab79fc83 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Received event network-vif-unplugged-4a601377-1147-4c58-9ff9-5fb6c1610844 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:26.176666 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-3db299bd-5bd0-4698-b277-ce68f24b9066 req-e6e386b3-9271-4c16-a687-6680ab79fc83 service nova] Acquiring lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:26.176843 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-3db299bd-5bd0-4698-b277-ce68f24b9066 req-e6e386b3-9271-4c16-a687-6680ab79fc83 service nova] Lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:26.176978 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-3db299bd-5bd0-4698-b277-ce68f24b9066 req-e6e386b3-9271-4c16-a687-6680ab79fc83 service nova] Lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:26.177087 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-3db299bd-5bd0-4698-b277-ce68f24b9066 req-e6e386b3-9271-4c16-a687-6680ab79fc83 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] No waiting events found dispatching network-vif-unplugged-4a601377-1147-4c58-9ff9-5fb6c1610844 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:26.177202 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-3db299bd-5bd0-4698-b277-ce68f24b9066 req-e6e386b3-9271-4c16-a687-6680ab79fc83 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Received unexpected event network-vif-unplugged-4a601377-1147-4c58-9ff9-5fb6c1610844 for instance with vm_state active and task_state rescuing. Jun 25 04:45:26.178521 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-6d4e8cb6-2f38-49aa-8b65-7d43d625f06c tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: d50f4386-5be2-4ba5-b63f-8cca28d53bbd] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:26.197874 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-0d579b44-a219-4f75-a830-072d73f11272 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 57cfae71-795b-408e-850f-5293a22274c3] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:26.201498 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:26.206846 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Acquiring lock "2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:26.206846 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Lock "2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:26.209651 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Attempting rescue Jun 25 04:45:26.210386 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98952) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}} Jun 25 04:45:26.216779 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Instance directory exists: not creating {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}} Jun 25 04:45:26.216843 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Creating image(s) Jun 25 04:45:26.218871 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6afb3ec-b48f-4dd6-95a1-d3c097b5203c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:26.219038 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "/opt/stack/data/nova/instances/e6afb3ec-b48f-4dd6-95a1-d3c097b5203c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:26.219733 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "/opt/stack/data/nova/instances/e6afb3ec-b48f-4dd6-95a1-d3c097b5203c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:26.219920 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lazy-loading 'trusted_certs' on Instance uuid e6afb3ec-b48f-4dd6-95a1-d3c097b5203c {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:26.327746 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "refresh_cache-520409fb-f97c-4503-b97b-7cecd377102a" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:45:26.327746 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquired lock "refresh_cache-520409fb-f97c-4503-b97b-7cecd377102a" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:45:26.327746 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:45:26.351393 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Acquiring lock "refresh_cache-d0e9b114-f17b-4b1e-b8e1-b1a821f38974" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:45:26.436697 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-56748a86-1c57-4d93-ade5-255e917c3e68 req-d58175cb-215e-4d8c-9768-b2bcf67227ed service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:26.710411 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Lazy-loading 'flavor' on Instance uuid 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:26.721975 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:45:26.723268 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:45:26.728039 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:45:26.730104 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquiring lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:26.730536 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:26.731050 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:45:26.735292 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:45:26.736013 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:26.761320 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-56748a86-1c57-4d93-ade5-255e917c3e68 req-d58175cb-215e-4d8c-9768-b2bcf67227ed service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:26.834219 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:26.835785 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.100s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:26.837092 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/e6afb3ec-b48f-4dd6-95a1-d3c097b5203c/disk.rescue {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:26.905148 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/e6afb3ec-b48f-4dd6-95a1-d3c097b5203c/disk.rescue" returned: 0 in 0.068s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:26.906402 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.176s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:26.906905 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lazy-loading 'migration_context' on Instance uuid e6afb3ec-b48f-4dd6-95a1-d3c097b5203c {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:26.951282 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Acquiring lock "e4a08308-60a9-4414-a985-e92f46b5894c" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:26.951282 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Lock "e4a08308-60a9-4414-a985-e92f46b5894c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:27.017161 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-56748a86-1c57-4d93-ade5-255e917c3e68 req-d58175cb-215e-4d8c-9768-b2bcf67227ed service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Added VIF to instance network info cache for port af0911e1-6cbd-42bf-aef4-7003f4f4e730. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3530}} Jun 25 04:45:27.017952 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-56748a86-1c57-4d93-ade5-255e917c3e68 req-d58175cb-215e-4d8c-9768-b2bcf67227ed service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Updating instance_info_cache with network_info: [{"id": "e58dc647-6432-4d80-82f6-4917696714ba", "address": "fa:16:3e:54:f0:58", "network": {"id": "778b960f-1779-4399-aec5-b9ce77e8af12", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127978990-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "394c4d7e8a6f4b7e8fbefeb88f1f4022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape58dc647-64", "ovs_interfaceid": "e58dc647-6432-4d80-82f6-4917696714ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af0911e1-6cbd-42bf-aef4-7003f4f4e730", "address": "fa:16:3e:87:35:c5", "network": {"id": "260156eb-43c2-4baf-b4eb-6977b7f8121c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1779399057", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "394c4d7e8a6f4b7e8fbefeb88f1f4022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0911e1-6c", "ovs_interfaceid": "af0911e1-6cbd-42bf-aef4-7003f4f4e730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:45:27.214082 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Ignoring supplied device name: /dev/vdb Jun 25 04:45:27.225584 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:27.378394 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Updating instance_info_cache with network_info: [{"id": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "address": "fa:16:3e:55:5b:09", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa967a2fd-f8", "ovs_interfaceid": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:45:27.410650 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:45:27.411116 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Created local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 25 04:45:27.411675 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Start _get_guest_xml network_info=[{"id": "4a601377-1147-4c58-9ff9-5fb6c1610844", "address": "fa:16:3e:59:7d:cd", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "vif_mac": "fa:16:3e:59:7d:cd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a601377-11", "ovs_interfaceid": "4a601377-1147-4c58-9ff9-5fb6c1610844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue={'image_id': '4ecaf199-c1b9-4ce3-869c-178c170c1662', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:45:27.411955 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lazy-loading 'resources' on Instance uuid e6afb3ec-b48f-4dd6-95a1-d3c097b5203c {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:27.454679 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:45:27.520426 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-56748a86-1c57-4d93-ade5-255e917c3e68 req-d58175cb-215e-4d8c-9768-b2bcf67227ed service nova] Releasing lock "refresh_cache-d0e9b114-f17b-4b1e-b8e1-b1a821f38974" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:45:27.521007 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Acquired lock "refresh_cache-d0e9b114-f17b-4b1e-b8e1-b1a821f38974" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:45:27.521156 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:45:27.718705 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Lock "2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.512s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:27.831671 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:27.881068 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Releasing lock "refresh_cache-520409fb-f97c-4503-b97b-7cecd377102a" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:45:27.913703 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:45:27.917086 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:45:27.920431 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-65956904', uuid='e6afb3ec-b48f-4dd6-95a1-d3c097b5203c'), owner=OwnerMeta(userid='ecbe28912a3b48e2b7c9023b1615e0cc', username='tempest-ServerRescueNegativeTestJSON-1184161043-project-member', projectid='8c14752bebb0420a9c82e4049038bcc3', projectname='tempest-ServerRescueNegativeTestJSON-1184161043'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4a601377-1147-4c58-9ff9-5fb6c1610844", "address": "fa:16:3e:59:7d:cd", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "vif_mac": "fa:16:3e:59:7d:cd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a601377-11", "ovs_interfaceid": "4a601377-1147-4c58-9ff9-5fb6c1610844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362727.918292) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:45:27.921508 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:45:27.921842 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:45:27.922758 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:45:27.923024 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:45:27.924060 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:45:27.924486 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:45:27.924666 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:45:27.924866 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:45:27.924866 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:45:27.925011 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:45:27.925164 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:45:27.925397 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:45:27.925727 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:45:27.925888 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:45:27.926037 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:45:27.926214 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:45:27.926431 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lazy-loading 'vcpu_model' on Instance uuid e6afb3ec-b48f-4dd6-95a1-d3c097b5203c {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:28.012134 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:28.012348 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:28.019007 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:45:28.019417 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Claim successful on node np0000003587 Jun 25 04:45:28.103678 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-f74f2c8a-5296-46a1-ba7f-69f1f00ad14e req-257b5564-baaf-4553-a001-4b30dd4f5076 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Received event network-vif-unplugged-4a601377-1147-4c58-9ff9-5fb6c1610844 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:28.104188 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-f74f2c8a-5296-46a1-ba7f-69f1f00ad14e req-257b5564-baaf-4553-a001-4b30dd4f5076 service nova] Acquiring lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:28.106017 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-f74f2c8a-5296-46a1-ba7f-69f1f00ad14e req-257b5564-baaf-4553-a001-4b30dd4f5076 service nova] Lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:28.106251 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-f74f2c8a-5296-46a1-ba7f-69f1f00ad14e req-257b5564-baaf-4553-a001-4b30dd4f5076 service nova] Lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:28.106584 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-f74f2c8a-5296-46a1-ba7f-69f1f00ad14e req-257b5564-baaf-4553-a001-4b30dd4f5076 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] No waiting events found dispatching network-vif-unplugged-4a601377-1147-4c58-9ff9-5fb6c1610844 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:28.106718 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-f74f2c8a-5296-46a1-ba7f-69f1f00ad14e req-257b5564-baaf-4553-a001-4b30dd4f5076 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Received unexpected event network-vif-unplugged-4a601377-1147-4c58-9ff9-5fb6c1610844 for instance with vm_state active and task_state rescuing. Jun 25 04:45:28.162930 np0000003587 nova-compute[98952]: WARNING nova.network.neutron [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] 260156eb-43c2-4baf-b4eb-6977b7f8121c already exists in list: networks containing: ['260156eb-43c2-4baf-b4eb-6977b7f8121c']. ignoring it Jun 25 04:45:28.163216 np0000003587 nova-compute[98952]: WARNING nova.network.neutron [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] af0911e1-6cbd-42bf-aef4-7003f4f4e730 already exists in list: port_ids containing: ['af0911e1-6cbd-42bf-aef4-7003f4f4e730']. ignoring it Jun 25 04:45:28.404029 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:28.429481 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:45:28.453998 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:44:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-65956904',display_name='tempest-ServerRescueNegativeTestJSON-server-65956904',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-serverrescuenegativetestjson-server-65956904',id=23,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-25T04:45:01Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8c14752bebb0420a9c82e4049038bcc3',ramdisk_id='',reservation_id='r-y51q94gs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1184161043',owner_user_name='tempest-ServerRescueNegativeTestJSON-1184161043-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:45:02Z,user_data=None,user_id='ecbe28912a3b48e2b7c9023b1615e0cc',uuid=e6afb3ec-b48f-4dd6-95a1-d3c097b5203c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a601377-1147-4c58-9ff9-5fb6c1610844", "address": "fa:16:3e:59:7d:cd", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "vif_mac": "fa:16:3e:59:7d:cd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a601377-11", "ovs_interfaceid": "4a601377-1147-4c58-9ff9-5fb6c1610844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:45:28.454272 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Converting VIF {"id": "4a601377-1147-4c58-9ff9-5fb6c1610844", "address": "fa:16:3e:59:7d:cd", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "vif_mac": "fa:16:3e:59:7d:cd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a601377-11", "ovs_interfaceid": "4a601377-1147-4c58-9ff9-5fb6c1610844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:45:28.454939 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:7d:cd,bridge_name='br-int',has_traffic_filtering=True,id=4a601377-1147-4c58-9ff9-5fb6c1610844,network=Network(06c0ad47-4541-470f-826b-31e1b541d27e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a601377-11') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:45:28.456690 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lazy-loading 'pci_devices' on Instance uuid e6afb3ec-b48f-4dd6-95a1-d3c097b5203c {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:28.647136 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Acquiring lock "2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:28.650134 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Lock "2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.003s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:28.650591 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Attaching volume 1ff12be7-cce2-435c-bba7-2b9802df56d9 to /dev/vdb Jun 25 04:45:28.710495 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.80', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003587', 'execute': None}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:45:28.723145 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.scaleio [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98952) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 25 04:45:28.747168 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Running cmd (subprocess): nvme version {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:28.793892 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:28.796538 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] 'nvme version' failed. Not Retrying. {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 04:45:28.797075 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] nvme not present on system {{(pid=98952) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 25 04:45:28.805027 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98952) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 25 04:45:28.806549 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.lightos [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Current host hostNQN and IP(s) are ['10.4.3.80', 'fe80::f816:3eff:feea:dfe4', '192.168.40.6', 'fe80::f816:3eff:fe4f:7c42', '192.168.50.6', 'fe80::f816:3eff:fe6c:e6a6', '192.168.10.6', 'fe80::f816:3eff:fe17:d749', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::b035:28ff:fe70:6f4a', 'fe80::fc16:3eff:fe78:7ac8', 'fe80::1038:1dff:fe1c:d44b', 'fe80::fc16:3eff:fe3a:4858', 'fe80::fc16:3eff:fe4f:4083', 'fe80::fc16:3eff:fe55:5b09', 'fe80::fc16:3eff:fe54:f058', 'fe80::c80b:26ff:fea1:f17c', 'fe80::fc16:3eff:fe5a:f24b', 'fe80::6c47:21ff:fe4b:e2cc', 'fe80::fc16:3eff:fe57:c07f', 'fe80::fc16:3eff:fe01:4b19', 'fe80::c096:18ff:fe44:3261', 'fe80::9031:12ff:fefb:c0b2', 'fe80::fc16:3eff:fef5:86eb', 'fe80::38d3:89ff:fe81:f241', 'fe80::fc16:3eff:fe32:f4b4'] Jun 25 04:45:28.806865 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 25 04:45:28.807061 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] LIGHTOS: no hostnqn found. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 25 04:45:28.807313 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.80', 'host': 'np0000003587', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c81886224652', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a1feb13-40e2-4ac6-989e-b08a6fc0f283', 'nvme_native_multipath': False} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:45:28.807583 np0000003587 nova-compute[98952]: DEBUG nova.virt.block_device [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Updating existing volume attachment record: e84d5851-39ce-4034-bb7a-b604a3494bd8 {{(pid=98952) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 25 04:45:28.958924 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] End _get_guest_xml xml= Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: instance-00000017 Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: 196608 Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: tempest-ServerRescueNegativeTestJSON-server-65956904 Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: 2026-06-25 04:45:27 Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: 192 Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: 0 Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: 0 Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: True Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: bare Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: 0 Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: ide Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: virtio Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: pc Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: virtio Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: virtio Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: virtio Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: tempest-ServerRescueNegativeTestJSON-1184161043-project-member Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: tempest-ServerRescueNegativeTestJSON-1184161043 Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: hvm Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: 128 Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: Jun 25 04:45:28.960902 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:45:28.966337 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Instance destroyed successfully. Jun 25 04:45:28.973200 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Updating instance_info_cache with network_info: [{"id": "e58dc647-6432-4d80-82f6-4917696714ba", "address": "fa:16:3e:54:f0:58", "network": {"id": "778b960f-1779-4399-aec5-b9ce77e8af12", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127978990-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "394c4d7e8a6f4b7e8fbefeb88f1f4022", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape58dc647-64", "ovs_interfaceid": "e58dc647-6432-4d80-82f6-4917696714ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af0911e1-6cbd-42bf-aef4-7003f4f4e730", "address": "fa:16:3e:87:35:c5", "network": {"id": "260156eb-43c2-4baf-b4eb-6977b7f8121c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1779399057", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "394c4d7e8a6f4b7e8fbefeb88f1f4022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0911e1-6c", "ovs_interfaceid": "af0911e1-6cbd-42bf-aef4-7003f4f4e730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:45:29.198743 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-7d5e8135-824a-4f13-b597-da73bb222504 req-77aff265-32dd-4df6-bb82-6cd8c64420f8 service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Received event network-vif-unplugged-af0911e1-6cbd-42bf-aef4-7003f4f4e730 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:29.200331 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-7d5e8135-824a-4f13-b597-da73bb222504 req-77aff265-32dd-4df6-bb82-6cd8c64420f8 service nova] Acquiring lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:29.201421 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-7d5e8135-824a-4f13-b597-da73bb222504 req-77aff265-32dd-4df6-bb82-6cd8c64420f8 service nova] Lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:29.201756 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-7d5e8135-824a-4f13-b597-da73bb222504 req-77aff265-32dd-4df6-bb82-6cd8c64420f8 service nova] Lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:29.201993 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-7d5e8135-824a-4f13-b597-da73bb222504 req-77aff265-32dd-4df6-bb82-6cd8c64420f8 service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] No waiting events found dispatching network-vif-unplugged-af0911e1-6cbd-42bf-aef4-7003f4f4e730 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:29.202524 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-7d5e8135-824a-4f13-b597-da73bb222504 req-77aff265-32dd-4df6-bb82-6cd8c64420f8 service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Received unexpected event network-vif-unplugged-af0911e1-6cbd-42bf-aef4-7003f4f4e730 for instance with vm_state active and task_state None. Jun 25 04:45:29.389881 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Calling os-brick to attach iSCSI Volume {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 25 04:45:29.390413 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9', 'iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ff12be7-cce2-435c-bba7-2b9802df56d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:45:29.390630 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:45:29.391105 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:45:29.391413 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9', 'iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ff12be7-cce2-435c-bba7-2b9802df56d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 25 04:45:29.398618 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Starting migrate_disk_and_power_off {{(pid=98952) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12621}} Jun 25 04:45:29.407308 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:45:29.407904 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:45:29.414277 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:45:29.414477 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:45:29.415656 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:45:29.415986 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:45:29.428227 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:45:29.428227 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:29.429643 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:29.435396 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:29.439072 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:45:29.439072 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:29.453889 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9] added Jun 25 04:45:29.453889 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:45:29.453889 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:45:29.453889 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:45:29.453889 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:45:29.453889 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:45:29.453889 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:29.459795 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9] added Jun 25 04:45:29.459795 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:45:29.459795 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:45:29.459795 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:45:29.459795 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:45:29.459795 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:45:29.459795 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:29.461330 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:45:29.461927 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:45:29.462278 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:29.466995 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0472(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:45:29.467438 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0463(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:45:29.467805 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:45:29.468012 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:45:29.475757 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Releasing lock "refresh_cache-d0e9b114-f17b-4b1e-b8e1-b1a821f38974" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:45:29.482579 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:44:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-715977744',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-715977744',id=21,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ31TiHTvkG1TqpPZ0eyA8zlJgWDgQ1Y4UudhVnxlIpmir8fEolbd1IR9P777kIxNtNGkwQxVlIHyNMjGJC34A1Z1juzVJx1D5ZrNzRanvOb0pRYxCKEEsRGPmuJwmfFVA==',key_name='tempest-keypair-1775299019',keypairs=,launch_index=0,launched_at=2026-06-25T04:44:42Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='394c4d7e8a6f4b7e8fbefeb88f1f4022',ramdisk_id='',reservation_id='r-lkwtjldh',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-9126716',owner_user_name='tempest-TaggedAttachmentsTest-9126716-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:44:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5da5f5d0548e4d11b82042832880176d',uuid=d0e9b114-f17b-4b1e-b8e1-b1a821f38974,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af0911e1-6cbd-42bf-aef4-7003f4f4e730", "address": "fa:16:3e:87:35:c5", "network": {"id": "260156eb-43c2-4baf-b4eb-6977b7f8121c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1779399057", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "394c4d7e8a6f4b7e8fbefeb88f1f4022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0911e1-6c", "ovs_interfaceid": "af0911e1-6cbd-42bf-aef4-7003f4f4e730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:45:29.482579 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Converting VIF {"id": "af0911e1-6cbd-42bf-aef4-7003f4f4e730", "address": "fa:16:3e:87:35:c5", "network": {"id": "260156eb-43c2-4baf-b4eb-6977b7f8121c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1779399057", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "394c4d7e8a6f4b7e8fbefeb88f1f4022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0911e1-6c", "ovs_interfaceid": "af0911e1-6cbd-42bf-aef4-7003f4f4e730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:45:29.482906 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:35:c5,bridge_name='br-int',has_traffic_filtering=True,id=af0911e1-6cbd-42bf-aef4-7003f4f4e730,network=Network(260156eb-43c2-4baf-b4eb-6977b7f8121c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf0911e1-6c') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:45:29.483249 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:35:c5,bridge_name='br-int',has_traffic_filtering=True,id=af0911e1-6cbd-42bf-aef4-7003f4f4e730,network=Network(260156eb-43c2-4baf-b4eb-6977b7f8121c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf0911e1-6c') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:45:29.486583 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:29.486583 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:29.486583 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:45:29.486583 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:29.486583 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b03915c9-fed5-52e8-b026-b818cd13159d', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:29.487159 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:29.487990 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:45:29.502723 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:29.506165 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:29.506394 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf0911e1-6c, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:29.506781 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf0911e1-6c, col_values=(('qos', UUID('80efe103-8bc7-49b5-9681-7a5a6e2c8786')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:29.506968 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf0911e1-6c, col_values=(('external_ids', {'iface-id': 'af0911e1-6cbd-42bf-aef4-7003f4f4e730', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:35:c5', 'vm-uuid': 'd0e9b114-f17b-4b1e-b8e1-b1a821f38974'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:29.512445 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:29.514080 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:45:29.528011 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:29.529006 np0000003587 nova-compute[98952]: INFO os_vif [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:35:c5,bridge_name='br-int',has_traffic_filtering=True,id=af0911e1-6cbd-42bf-aef4-7003f4f4e730,network=Network(260156eb-43c2-4baf-b4eb-6977b7f8121c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf0911e1-6c') Jun 25 04:45:29.529965 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:44:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-715977744',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-715977744',id=21,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ31TiHTvkG1TqpPZ0eyA8zlJgWDgQ1Y4UudhVnxlIpmir8fEolbd1IR9P777kIxNtNGkwQxVlIHyNMjGJC34A1Z1juzVJx1D5ZrNzRanvOb0pRYxCKEEsRGPmuJwmfFVA==',key_name='tempest-keypair-1775299019',keypairs=,launch_index=0,launched_at=2026-06-25T04:44:42Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='394c4d7e8a6f4b7e8fbefeb88f1f4022',ramdisk_id='',reservation_id='r-lkwtjldh',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-9126716',owner_user_name='tempest-TaggedAttachmentsTest-9126716-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:44:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5da5f5d0548e4d11b82042832880176d',uuid=d0e9b114-f17b-4b1e-b8e1-b1a821f38974,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af0911e1-6cbd-42bf-aef4-7003f4f4e730", "address": "fa:16:3e:87:35:c5", "network": {"id": "260156eb-43c2-4baf-b4eb-6977b7f8121c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1779399057", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "394c4d7e8a6f4b7e8fbefeb88f1f4022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0911e1-6c", "ovs_interfaceid": "af0911e1-6cbd-42bf-aef4-7003f4f4e730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:45:29.530185 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Converting VIF {"id": "af0911e1-6cbd-42bf-aef4-7003f4f4e730", "address": "fa:16:3e:87:35:c5", "network": {"id": "260156eb-43c2-4baf-b4eb-6977b7f8121c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1779399057", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "394c4d7e8a6f4b7e8fbefeb88f1f4022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0911e1-6c", "ovs_interfaceid": "af0911e1-6cbd-42bf-aef4-7003f4f4e730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:45:29.530864 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:35:c5,bridge_name='br-int',has_traffic_filtering=True,id=af0911e1-6cbd-42bf-aef4-7003f4f4e730,network=Network(260156eb-43c2-4baf-b4eb-6977b7f8121c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf0911e1-6c') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:45:29.532668 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] attach device xml: Jun 25 04:45:29.532668 np0000003587 nova-compute[98952]: Jun 25 04:45:29.532668 np0000003587 nova-compute[98952]: Jun 25 04:45:29.532668 np0000003587 nova-compute[98952]: Jun 25 04:45:29.532668 np0000003587 nova-compute[98952]: Jun 25 04:45:29.532668 np0000003587 nova-compute[98952]: Jun 25 04:45:29.532668 np0000003587 nova-compute[98952]: Jun 25 04:45:29.532668 np0000003587 nova-compute[98952]: {{(pid=98952) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 25 04:45:29.569527 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:29.633791 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:29.657637 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:29.658436 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:29.663602 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:29.701267 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:29.823120 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:29.839737 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:29.854103 np0000003587 nova-compute[98952]: DEBUG nova.utils [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Queued Task(fn=>, remaining_delay=14.999640604999968 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:29.859120 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Instance destroyed successfully. Jun 25 04:45:29.861909 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:43:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='multiattach-server-1',id=19,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV/p3ZeuUk+pDtRyjEqB6LGacp/8M+rMj60nbQpQu7IIRoy9lFRhD1vsgSIFDZ+PjS4ytFpGVQZ3frW+0uH/J+qnA92sFXepo+od7tCOydqRChW2tpsraqZi+iIk6G08A==',key_name='tempest-keypair-462979399',keypairs=,launch_index=0,launched_at=2026-06-25T04:43:53Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='284d191aa82f453cabcfd18172f74099',ramdisk_id='',reservation_id='r-tn9kc6s5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1256899935',owner_user_name='tempest-AttachVolumeMultiAttachTest-1256899935-project-member'},tags=,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:45:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='947bde0e827c45f5bab008d094816d8c',uuid=520409fb-f97c-4503-b97b-7cecd377102a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "address": "fa:16:3e:55:5b:09", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "vif_mac": "fa:16:3e:55:5b:09"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa967a2fd-f8", "ovs_interfaceid": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:45:29.861909 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converting VIF {"id": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "address": "fa:16:3e:55:5b:09", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "vif_mac": "fa:16:3e:55:5b:09"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa967a2fd-f8", "ovs_interfaceid": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:45:29.861909 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:5b:09,bridge_name='br-int',has_traffic_filtering=True,id=a967a2fd-f804-4a2d-b980-fae0336ab02c,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa967a2fd-f8') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:45:29.861909 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:5b:09,bridge_name='br-int',has_traffic_filtering=True,id=a967a2fd-f804-4a2d-b980-fae0336ab02c,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa967a2fd-f8') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:45:29.864482 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:29.864982 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa967a2fd-f8, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:29.867909 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:29.870417 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:45:29.880003 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:29.882504 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:29.882756 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=440a7535-8fe2-452e-b285-04a6bb50a78f) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:29.883651 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:29.884337 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:45:29.899777 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:29.905066 np0000003587 nova-compute[98952]: INFO os_vif [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:5b:09,bridge_name='br-int',has_traffic_filtering=True,id=a967a2fd-f804-4a2d-b980-fae0336ab02c,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa967a2fd-f8') Jun 25 04:45:29.952410 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:45:29.952728 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:45:30.037224 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:30.081448 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:30.091846 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:30.096825 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:30.130398 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:30.143640 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:30.216886 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-5ddc7b58-1ea8-42e3-91e5-5f2dbaad1318 req-8fa14210-73bb-4510-ad6d-967662ed3b4d service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Received event network-vif-unplugged-a967a2fd-f804-4a2d-b980-fae0336ab02c {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:30.219392 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-5ddc7b58-1ea8-42e3-91e5-5f2dbaad1318 req-8fa14210-73bb-4510-ad6d-967662ed3b4d service nova] Acquiring lock "520409fb-f97c-4503-b97b-7cecd377102a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:30.219392 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-5ddc7b58-1ea8-42e3-91e5-5f2dbaad1318 req-8fa14210-73bb-4510-ad6d-967662ed3b4d service nova] Lock "520409fb-f97c-4503-b97b-7cecd377102a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:30.219755 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-5ddc7b58-1ea8-42e3-91e5-5f2dbaad1318 req-8fa14210-73bb-4510-ad6d-967662ed3b4d service nova] Lock "520409fb-f97c-4503-b97b-7cecd377102a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:30.219755 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-5ddc7b58-1ea8-42e3-91e5-5f2dbaad1318 req-8fa14210-73bb-4510-ad6d-967662ed3b4d service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] No waiting events found dispatching network-vif-unplugged-a967a2fd-f804-4a2d-b980-fae0336ab02c {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:30.219910 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-5ddc7b58-1ea8-42e3-91e5-5f2dbaad1318 req-8fa14210-73bb-4510-ad6d-967662ed3b4d service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Received unexpected event network-vif-unplugged-a967a2fd-f804-4a2d-b980-fae0336ab02c for instance with vm_state active and task_state resize_migrating. Jun 25 04:45:30.219910 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-5ddc7b58-1ea8-42e3-91e5-5f2dbaad1318 req-8fa14210-73bb-4510-ad6d-967662ed3b4d service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Received event network-vif-unplugged-a967a2fd-f804-4a2d-b980-fae0336ab02c {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:30.220007 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-5ddc7b58-1ea8-42e3-91e5-5f2dbaad1318 req-8fa14210-73bb-4510-ad6d-967662ed3b4d service nova] Acquiring lock "520409fb-f97c-4503-b97b-7cecd377102a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:30.220149 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-5ddc7b58-1ea8-42e3-91e5-5f2dbaad1318 req-8fa14210-73bb-4510-ad6d-967662ed3b4d service nova] Lock "520409fb-f97c-4503-b97b-7cecd377102a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:30.220239 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-5ddc7b58-1ea8-42e3-91e5-5f2dbaad1318 req-8fa14210-73bb-4510-ad6d-967662ed3b4d service nova] Lock "520409fb-f97c-4503-b97b-7cecd377102a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:30.220915 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-5ddc7b58-1ea8-42e3-91e5-5f2dbaad1318 req-8fa14210-73bb-4510-ad6d-967662ed3b4d service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] No waiting events found dispatching network-vif-unplugged-a967a2fd-f804-4a2d-b980-fae0336ab02c {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:30.221318 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-5ddc7b58-1ea8-42e3-91e5-5f2dbaad1318 req-8fa14210-73bb-4510-ad6d-967662ed3b4d service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Received unexpected event network-vif-unplugged-a967a2fd-f804-4a2d-b980-fae0336ab02c for instance with vm_state active and task_state resize_migrating. Jun 25 04:45:30.457221 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:45:30.467134 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Detected multiple connections on this host for volume: 89748225-9d41-4fb1-b47a-f0f88aa6ebfa, skipping target disconnect. Jun 25 04:45:30.468481 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:45:30.469732 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.40.100 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:45:30.490816 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:30.495495 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:45:30.499432 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:45:30.499432 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:45:30.499432 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:45:30.499956 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] No VIF found with MAC fa:16:3e:59:7d:cd, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:45:30.501081 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Using config drive Jun 25 04:45:30.506897 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.50.100 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:45:30.516549 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:30.526584 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:30.526584 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:30.526584 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:30.526584 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:30.526584 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:30.526584 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:30.526584 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:45:30.526905 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:30.526905 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:30.526905 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:30.526905 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:30.526905 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:30.526905 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:30.526905 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:45:30.533159 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:30.541319 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:30.553628 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:30.553628 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:30.553628 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:30.553628 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:30.553628 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:30.553628 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:30.553628 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:45:30.554012 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:30.554012 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:30.554012 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:30.554012 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:30.554012 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:30.554012 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:30.554012 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:45:30.577837 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9, portal: 192.168.40.100,3260] Jun 25 04:45:30.577837 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9, portal: 192.168.40.100,3260] successful. Jun 25 04:45:30.577837 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:30.578635 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:30.579264 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:30.595290 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:30.606149 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9, portal: 192.168.50.100,3260] Jun 25 04:45:30.606149 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9, portal: 192.168.50.100,3260] successful. Jun 25 04:45:30.606149 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:30.616638 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:30.616638 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:30.616638 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:30.616638 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:30.616638 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:30.616638 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:30.616638 np0000003587 nova-compute[98952]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:30.616638 np0000003587 nova-compute[98952]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:30.616638 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:45:30.616638 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:30.616638 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:30.616638 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:30.616638 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:30.616638 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:30.616638 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:30.616638 np0000003587 nova-compute[98952]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:30.616638 np0000003587 nova-compute[98952]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:30.616638 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:45:30.616638 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:45:30.617271 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Connected to 192.168.40.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:45:30.619946 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] HCTL ('9', '-', '-', 0) found on session 41 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:45:30.619946 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:45:30.625661 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:30.644292 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Searching for a device in session 41 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:45:30.644292 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ff12be7-cce2-435c-bba7-2b9802df56d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:45:30.650211 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:30.650211 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:30.650211 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:30.650211 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:30.650211 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:30.650211 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:30.650211 np0000003587 nova-compute[98952]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:30.650211 np0000003587 nova-compute[98952]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:30.650211 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:45:30.650504 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:30.650504 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:30.650504 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:30.650504 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:30.650504 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:30.650504 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:30.650504 np0000003587 nova-compute[98952]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:30.650504 np0000003587 nova-compute[98952]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:30.650504 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:45:30.650970 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.237s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:45:30.651390 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Connected to 192.168.50.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:45:30.652222 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] HCTL ('10', '-', '-', 0) found on session 42 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:45:30.652453 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:45:30.671088 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Searching for a device in session 42 and hctl ['10', '*', '*', 0] yield: None {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:45:30.689790 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:30.691693 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] skipping disk /dev/dm-18 (vdb) as it is a volume {{(pid=98952) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 25 04:45:30.692240 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a_resize/disk /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:30.821121 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "cp -r /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a_resize/disk /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk" returned: 0 in 0.128s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:30.821121 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a_resize/disk.config /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk.config {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:30.879665 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "cp -r /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a_resize/disk.config /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk.config" returned: 0 in 0.058s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:30.880540 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a_resize/disk.info /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk.info {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:30.929671 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "cp -r /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a_resize/disk.info /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk.info" returned: 0 in 0.049s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:30.965733 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.953s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:30.966268 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:45:31.009533 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lazy-loading 'ec2_ids' on Instance uuid e6afb3ec-b48f-4dd6-95a1-d3c097b5203c {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:31.235959 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:45:31.236314 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:45:31.236314 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] No VIF found with MAC fa:16:3e:54:f0:58, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:45:31.281596 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-ed44b79b-dfa5-4131-af54-fa6b70a47ddc req-f1586a5f-d6e0-46fb-a8f4-ebf1edd2f256 service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Received event network-vif-plugged-af0911e1-6cbd-42bf-aef4-7003f4f4e730 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:31.281851 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ed44b79b-dfa5-4131-af54-fa6b70a47ddc req-f1586a5f-d6e0-46fb-a8f4-ebf1edd2f256 service nova] Acquiring lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:31.282057 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ed44b79b-dfa5-4131-af54-fa6b70a47ddc req-f1586a5f-d6e0-46fb-a8f4-ebf1edd2f256 service nova] Lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:31.282180 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ed44b79b-dfa5-4131-af54-fa6b70a47ddc req-f1586a5f-d6e0-46fb-a8f4-ebf1edd2f256 service nova] Lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:31.282960 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-ed44b79b-dfa5-4131-af54-fa6b70a47ddc req-f1586a5f-d6e0-46fb-a8f4-ebf1edd2f256 service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] No waiting events found dispatching network-vif-plugged-af0911e1-6cbd-42bf-aef4-7003f4f4e730 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:31.282960 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-ed44b79b-dfa5-4131-af54-fa6b70a47ddc req-f1586a5f-d6e0-46fb-a8f4-ebf1edd2f256 service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Received unexpected event network-vif-plugged-af0911e1-6cbd-42bf-aef4-7003f4f4e730 for instance with vm_state active and task_state None. Jun 25 04:45:31.283185 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-ed44b79b-dfa5-4131-af54-fa6b70a47ddc req-f1586a5f-d6e0-46fb-a8f4-ebf1edd2f256 service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Received event network-vif-plugged-af0911e1-6cbd-42bf-aef4-7003f4f4e730 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:31.283215 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ed44b79b-dfa5-4131-af54-fa6b70a47ddc req-f1586a5f-d6e0-46fb-a8f4-ebf1edd2f256 service nova] Acquiring lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:31.283423 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ed44b79b-dfa5-4131-af54-fa6b70a47ddc req-f1586a5f-d6e0-46fb-a8f4-ebf1edd2f256 service nova] Lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:31.283531 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-ed44b79b-dfa5-4131-af54-fa6b70a47ddc req-f1586a5f-d6e0-46fb-a8f4-ebf1edd2f256 service nova] Lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:31.284052 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-ed44b79b-dfa5-4131-af54-fa6b70a47ddc req-f1586a5f-d6e0-46fb-a8f4-ebf1edd2f256 service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] No waiting events found dispatching network-vif-plugged-af0911e1-6cbd-42bf-aef4-7003f4f4e730 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:31.284445 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-ed44b79b-dfa5-4131-af54-fa6b70a47ddc req-f1586a5f-d6e0-46fb-a8f4-ebf1edd2f256 service nova] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Received unexpected event network-vif-plugged-af0911e1-6cbd-42bf-aef4-7003f4f4e730 for instance with vm_state active and task_state None. Jun 25 04:45:31.472894 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:45:31.473095 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:45:31.473483 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:31.473785 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:31.513480 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:45:31.513645 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lazy-loading 'keypairs' on Instance uuid e6afb3ec-b48f-4dd6-95a1-d3c097b5203c {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:31.561397 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fa107a6cc1b436694275db759f6e50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaed0d81f16d469ba74297ae650cdd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:45:31.671815 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Searching for a device in session 42 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:45:31.671992 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1ff12be7-cce2-435c-bba7-2b9802df56d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:45:31.744451 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-715977744', uuid='d0e9b114-f17b-4b1e-b8e1-b1a821f38974'), owner=OwnerMeta(userid='5da5f5d0548e4d11b82042832880176d', username='tempest-TaggedAttachmentsTest-9126716-project-member', projectid='394c4d7e8a6f4b7e8fbefeb88f1f4022', projectname='tempest-TaggedAttachmentsTest-9126716'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e58dc647-6432-4d80-82f6-4917696714ba", "address": "fa:16:3e:54:f0:58", "network": {"id": "778b960f-1779-4399-aec5-b9ce77e8af12", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127978990-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "394c4d7e8a6f4b7e8fbefeb88f1f4022", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape58dc647-64", "ovs_interfaceid": "e58dc647-6432-4d80-82f6-4917696714ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af0911e1-6cbd-42bf-aef4-7003f4f4e730", "address": "fa:16:3e:87:35:c5", "network": {"id": "260156eb-43c2-4baf-b4eb-6977b7f8121c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1779399057", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "394c4d7e8a6f4b7e8fbefeb88f1f4022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0911e1-6c", "ovs_interfaceid": "af0911e1-6cbd-42bf-aef4-7003f4f4e730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362731.7434206) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] set metadata xml: Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: tempest-device-tagging-server-715977744 Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: 2026-06-25 04:45:31 Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: 192 Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: 0 Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: 0 Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: True Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: bare Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: 0 Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: ide Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: virtio Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: pc Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: virtio Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: virtio Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: virtio Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: tempest-TaggedAttachmentsTest-9126716-project-member Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: tempest-TaggedAttachmentsTest-9126716 Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: Jun 25 04:45:31.745456 np0000003587 nova-compute[98952]: {{(pid=98952) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}} Jun 25 04:45:31.982550 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 25 04:45:32.018584 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:45:32.019417 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:32.137698 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:32.137698 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:32.214477 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Successfully created port: a8b4b139-0089-425a-b673-11beed785afd {{(pid=98952) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 25 04:45:32.227254 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Creating config drive at /opt/stack/data/nova/instances/e6afb3ec-b48f-4dd6-95a1-d3c097b5203c/disk.config.rescue Jun 25 04:45:32.232049 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e6afb3ec-b48f-4dd6-95a1-d3c097b5203c/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcljy9var {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:32.267255 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-9350213c-c237-4358-b31e-656188956847 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "interface-d0e9b114-f17b-4b1e-b8e1-b1a821f38974-None" "released" by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" :: held 9.391s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:32.296617 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Port a967a2fd-f804-4a2d-b980-fae0336ab02c binding to destination host np0000003587 is already ACTIVE {{(pid=98952) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} Jun 25 04:45:32.305410 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e6afb3ec-b48f-4dd6-95a1-d3c097b5203c/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcljy9var" returned: 0 in 0.074s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:32.436314 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Found WWN 33000000098819970 for multipath device dm-3 {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 25 04:45:32.436900 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:45:32.437597 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] <== connect_volume: return (3046ms) {'type': 'block', 'scsi_wwn': '33000000098819970', 'path': '/dev/dm-3', 'multipath_id': '33000000098819970'} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:45:32.437597 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000098819970', 'path': '/dev/dm-3', 'multipath_id': '33000000098819970'} {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 25 04:45:32.443703 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Lazy-loading 'flavor' on Instance uuid 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:32.486804 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Start building block device mappings for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 25 04:45:32.892327 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:32.923584 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:32.931887 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:32.947337 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] [instance: 2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2] Attempting to attach volume 1ff12be7-cce2-435c-bba7-2b9802df56d9 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98952) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 25 04:45:32.950504 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] attach device xml: Jun 25 04:45:32.950504 np0000003587 nova-compute[98952]: Jun 25 04:45:32.950504 np0000003587 nova-compute[98952]: Jun 25 04:45:32.950504 np0000003587 nova-compute[98952]: Jun 25 04:45:32.950504 np0000003587 nova-compute[98952]: Jun 25 04:45:32.950504 np0000003587 nova-compute[98952]: 1ff12be7-cce2-435c-bba7-2b9802df56d9 Jun 25 04:45:32.950504 np0000003587 nova-compute[98952]: Jun 25 04:45:32.950504 np0000003587 nova-compute[98952]: {{(pid=98952) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 25 04:45:33.055221 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:33.102941 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:33.104124 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:33.157154 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Successfully updated port: a8b4b139-0089-425a-b673-11beed785afd {{(pid=98952) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 25 04:45:33.213776 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Acquiring lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:33.213972 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:33.234581 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6640060b-19fb-4795-bfa7-ba7f1e97a8bf req-54e7ff1d-9242-4159-a924-84bccbcddf54 service nova] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Received event network-changed-a8b4b139-0089-425a-b673-11beed785afd {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:33.234824 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-6640060b-19fb-4795-bfa7-ba7f1e97a8bf req-54e7ff1d-9242-4159-a924-84bccbcddf54 service nova] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Refreshing instance network info cache due to event network-changed-a8b4b139-0089-425a-b673-11beed785afd. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:45:33.236445 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6640060b-19fb-4795-bfa7-ba7f1e97a8bf req-54e7ff1d-9242-4159-a924-84bccbcddf54 service nova] Acquiring lock "refresh_cache-e4a08308-60a9-4414-a985-e92f46b5894c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:45:33.236658 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6640060b-19fb-4795-bfa7-ba7f1e97a8bf req-54e7ff1d-9242-4159-a924-84bccbcddf54 service nova] Acquired lock "refresh_cache-e4a08308-60a9-4414-a985-e92f46b5894c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:45:33.236817 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-6640060b-19fb-4795-bfa7-ba7f1e97a8bf req-54e7ff1d-9242-4159-a924-84bccbcddf54 service nova] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Refreshing network info cache for port a8b4b139-0089-425a-b673-11beed785afd {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:45:33.309004 np0000003587 nova-compute[98952]: DEBUG nova.compute.rpcapi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98952) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 25 04:45:33.323071 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "520409fb-f97c-4503-b97b-7cecd377102a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:33.323807 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "520409fb-f97c-4503-b97b-7cecd377102a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:33.332382 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "520409fb-f97c-4503-b97b-7cecd377102a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.008s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:33.510234 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Start spawning the instance on the hypervisor. {{(pid=98952) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 25 04:45:33.511650 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Creating instance directory {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 25 04:45:33.515083 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Creating image(s) Jun 25 04:45:33.515719 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4a08308-60a9-4414-a985-e92f46b5894c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:33.515952 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Lock "/opt/stack/data/nova/instances/e4a08308-60a9-4414-a985-e92f46b5894c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:33.516577 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Lock "/opt/stack/data/nova/instances/e4a08308-60a9-4414-a985-e92f46b5894c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:33.517246 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:45:33.529940 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:45:33.531244 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:33.630881 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.099s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:33.635736 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Acquiring lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:33.636200 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.004s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:33.637400 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:45:33.640723 np0000003587 nova-compute[98952]: DEBUG oslo_utils.imageutils.format_inspector [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98952) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 25 04:45:33.641095 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:33.662192 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Acquiring lock "refresh_cache-e4a08308-60a9-4414-a985-e92f46b5894c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:45:33.720024 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lazy-loading 'flavor' on Instance uuid d0e9b114-f17b-4b1e-b8e1-b1a821f38974 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:33.739789 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-6640060b-19fb-4795-bfa7-ba7f1e97a8bf req-54e7ff1d-9242-4159-a924-84bccbcddf54 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:33.759604 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.118s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:33.760805 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/e4a08308-60a9-4414-a985-e92f46b5894c/disk 1073741824 {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:33.825440 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4,backing_fmt=raw /opt/stack/data/nova/instances/e4a08308-60a9-4414-a985-e92f46b5894c/disk 1073741824" returned: 0 in 0.064s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:33.826259 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Lock "8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.190s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:33.826617 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:33.867358 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-6640060b-19fb-4795-bfa7-ba7f1e97a8bf req-54e7ff1d-9242-4159-a924-84bccbcddf54 service nova] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:45:33.936912 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.110s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:33.937435 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4a08308-60a9-4414-a985-e92f46b5894c/disk. size=1073741824 {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 25 04:45:33.937788 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4a08308-60a9-4414-a985-e92f46b5894c/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:34.038342 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4a08308-60a9-4414-a985-e92f46b5894c/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:34.039440 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Cannot resize image /opt/stack/data/nova/instances/e4a08308-60a9-4414-a985-e92f46b5894c/disk to a smaller size. {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 25 04:45:34.039891 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Created local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 25 04:45:34.040093 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Ensure instance console log exists: /opt/stack/data/nova/instances/e4a08308-60a9-4414-a985-e92f46b5894c/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:45:34.040483 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:34.040740 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:34.040892 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:34.066792 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-6640060b-19fb-4795-bfa7-ba7f1e97a8bf req-54e7ff1d-9242-4159-a924-84bccbcddf54 service nova] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:45:34.219911 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Removed pending STOPPED event for e6afb3ec-b48f-4dd6-95a1-d3c097b5203c due to new event Resumed> {{(pid=98952) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 25 04:45:34.220240 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:45:34.220475 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] VM Resumed (Lifecycle Event) Jun 25 04:45:34.231634 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-5c2d0a45-94df-46d5-96d0-814b30d625f3 tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:34.351582 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:34.476154 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "refresh_cache-520409fb-f97c-4503-b97b-7cecd377102a" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:45:34.476294 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquired lock "refresh_cache-520409fb-f97c-4503-b97b-7cecd377102a" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:45:34.476484 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:45:34.573843 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-6640060b-19fb-4795-bfa7-ba7f1e97a8bf req-54e7ff1d-9242-4159-a924-84bccbcddf54 service nova] Releasing lock "refresh_cache-e4a08308-60a9-4414-a985-e92f46b5894c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:45:34.573843 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Acquired lock "refresh_cache-e4a08308-60a9-4414-a985-e92f46b5894c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:45:34.573843 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:45:34.734777 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:34.736591 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.523s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:34.740305 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:45:34.760172 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:45:34.760705 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:45:34.760705 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:45:34.760705 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] No VIF found with MAC fa:16:3e:5a:f2:4b, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:45:34.884251 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:34.981096 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:35.047353 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:35.152147 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Instance cache missing network info. {{(pid=98952) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 25 04:45:35.244895 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:45:35.245011 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] VM Started (Lifecycle Event) Jun 25 04:45:35.309149 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-b8c3d787-7a1e-4f53-a3b5-da6dd24198c8 req-b5957df0-5092-4419-b782-c717acf6ff35 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Received event network-vif-plugged-4a601377-1147-4c58-9ff9-5fb6c1610844 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:35.310455 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b8c3d787-7a1e-4f53-a3b5-da6dd24198c8 req-b5957df0-5092-4419-b782-c717acf6ff35 service nova] Acquiring lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:35.311850 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b8c3d787-7a1e-4f53-a3b5-da6dd24198c8 req-b5957df0-5092-4419-b782-c717acf6ff35 service nova] Lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:35.311850 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b8c3d787-7a1e-4f53-a3b5-da6dd24198c8 req-b5957df0-5092-4419-b782-c717acf6ff35 service nova] Lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:35.311850 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-b8c3d787-7a1e-4f53-a3b5-da6dd24198c8 req-b5957df0-5092-4419-b782-c717acf6ff35 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] No waiting events found dispatching network-vif-plugged-4a601377-1147-4c58-9ff9-5fb6c1610844 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:35.312045 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-b8c3d787-7a1e-4f53-a3b5-da6dd24198c8 req-b5957df0-5092-4419-b782-c717acf6ff35 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Received unexpected event network-vif-plugged-4a601377-1147-4c58-9ff9-5fb6c1610844 for instance with vm_state rescued and task_state unrescuing. Jun 25 04:45:35.313435 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-b8c3d787-7a1e-4f53-a3b5-da6dd24198c8 req-b5957df0-5092-4419-b782-c717acf6ff35 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Received event network-vif-plugged-4a601377-1147-4c58-9ff9-5fb6c1610844 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:35.313435 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b8c3d787-7a1e-4f53-a3b5-da6dd24198c8 req-b5957df0-5092-4419-b782-c717acf6ff35 service nova] Acquiring lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:35.313435 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b8c3d787-7a1e-4f53-a3b5-da6dd24198c8 req-b5957df0-5092-4419-b782-c717acf6ff35 service nova] Lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:35.313435 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-b8c3d787-7a1e-4f53-a3b5-da6dd24198c8 req-b5957df0-5092-4419-b782-c717acf6ff35 service nova] Lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:35.313435 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-b8c3d787-7a1e-4f53-a3b5-da6dd24198c8 req-b5957df0-5092-4419-b782-c717acf6ff35 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] No waiting events found dispatching network-vif-plugged-4a601377-1147-4c58-9ff9-5fb6c1610844 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:35.313435 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-b8c3d787-7a1e-4f53-a3b5-da6dd24198c8 req-b5957df0-5092-4419-b782-c717acf6ff35 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Received unexpected event network-vif-plugged-4a601377-1147-4c58-9ff9-5fb6c1610844 for instance with vm_state rescued and task_state unrescuing. Jun 25 04:45:35.402843 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:35.413394 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:35.496444 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-3edd2c95-31c7-4caf-b373-3adff6d93ccb tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Unrescuing Jun 25 04:45:35.496444 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-3edd2c95-31c7-4caf-b373-3adff6d93ccb tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquiring lock "refresh_cache-e6afb3ec-b48f-4dd6-95a1-d3c097b5203c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:45:35.496444 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-3edd2c95-31c7-4caf-b373-3adff6d93ccb tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquired lock "refresh_cache-e6afb3ec-b48f-4dd6-95a1-d3c097b5203c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:45:35.496444 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-3edd2c95-31c7-4caf-b373-3adff6d93ccb tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:45:35.584126 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Updating instance_info_cache with network_info: [{"id": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "address": "fa:16:3e:55:5b:09", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa967a2fd-f8", "ovs_interfaceid": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:45:35.587386 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Updating instance_info_cache with network_info: [{"id": "a8b4b139-0089-425a-b673-11beed785afd", "address": "fa:16:3e:59:ff:77", "network": {"id": "520b6853-4209-4e41-a303-5ca3ef4f0b30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1265554160-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eaed0d81f16d469ba74297ae650cdd5d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b4b139-00", "ovs_interfaceid": "a8b4b139-0089-425a-b673-11beed785afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:45:35.748515 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:35.751807 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:45:35.845059 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Acquiring lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:35.845059 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:35.847148 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Attaching volume 4a5030d5-9c33-4b30-8838-af5f1bf37953 to /dev/vdb Jun 25 04:45:35.908695 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.80', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003587', 'execute': None}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:45:35.924997 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.scaleio [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98952) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 25 04:45:35.956176 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Running cmd (subprocess): nvme version {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:36.000475 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-3edd2c95-31c7-4caf-b373-3adff6d93ccb tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:36.009573 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] 'nvme version' failed. Not Retrying. {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 04:45:36.010466 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] nvme not present on system {{(pid=98952) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 25 04:45:36.030270 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98952) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 25 04:45:36.032352 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.lightos [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Current host hostNQN and IP(s) are ['10.4.3.80', 'fe80::f816:3eff:feea:dfe4', '192.168.40.6', 'fe80::f816:3eff:fe4f:7c42', '192.168.50.6', 'fe80::f816:3eff:fe6c:e6a6', '192.168.10.6', 'fe80::f816:3eff:fe17:d749', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::b035:28ff:fe70:6f4a', 'fe80::fc16:3eff:fe78:7ac8', 'fe80::1038:1dff:fe1c:d44b', 'fe80::fc16:3eff:fe3a:4858', 'fe80::fc16:3eff:fe4f:4083', 'fe80::fc16:3eff:fe54:f058', 'fe80::c80b:26ff:fea1:f17c', 'fe80::fc16:3eff:fe5a:f24b', 'fe80::6c47:21ff:fe4b:e2cc', 'fe80::fc16:3eff:fe57:c07f', 'fe80::fc16:3eff:fe01:4b19', 'fe80::c096:18ff:fe44:3261', 'fe80::9031:12ff:fefb:c0b2', 'fe80::fc16:3eff:fef5:86eb', 'fe80::38d3:89ff:fe81:f241', 'fe80::fc16:3eff:fe32:f4b4', 'fe80::fc16:3eff:fe87:35c5', 'fe80::28f9:9eff:feb8:4ca3', 'fe80::fc16:3eff:fe59:7dcd'] Jun 25 04:45:36.032506 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 25 04:45:36.033344 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] LIGHTOS: no hostnqn found. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 25 04:45:36.033769 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.80', 'host': 'np0000003587', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c81886224652', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a1feb13-40e2-4ac6-989e-b08a6fc0f283', 'nvme_native_multipath': False} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:45:36.034063 np0000003587 nova-compute[98952]: DEBUG nova.virt.block_device [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Updating existing volume attachment record: a45f023c-ef3f-4ef3-b3b2-caff981caa66 {{(pid=98952) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 25 04:45:36.048982 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d1621e92-4af7-4ac6-95f7-387286c99aa3 req-f7cfa3e9-4270-4ef8-9b83-42272b8be561 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Received event network-changed-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:36.049466 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d1621e92-4af7-4ac6-95f7-387286c99aa3 req-f7cfa3e9-4270-4ef8-9b83-42272b8be561 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Refreshing instance network info cache due to event network-changed-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:45:36.049466 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d1621e92-4af7-4ac6-95f7-387286c99aa3 req-f7cfa3e9-4270-4ef8-9b83-42272b8be561 service nova] Acquiring lock "refresh_cache-8b915629-823e-4b55-bc64-d73e58b79bdc" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:45:36.049609 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d1621e92-4af7-4ac6-95f7-387286c99aa3 req-f7cfa3e9-4270-4ef8-9b83-42272b8be561 service nova] Acquired lock "refresh_cache-8b915629-823e-4b55-bc64-d73e58b79bdc" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:45:36.049654 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-d1621e92-4af7-4ac6-95f7-387286c99aa3 req-f7cfa3e9-4270-4ef8-9b83-42272b8be561 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Refreshing network info cache for port 4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:45:36.090110 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Releasing lock "refresh_cache-e4a08308-60a9-4414-a985-e92f46b5894c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:45:36.090603 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Instance network_info: |[{"id": "a8b4b139-0089-425a-b673-11beed785afd", "address": "fa:16:3e:59:ff:77", "network": {"id": "520b6853-4209-4e41-a303-5ca3ef4f0b30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1265554160-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eaed0d81f16d469ba74297ae650cdd5d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b4b139-00", "ovs_interfaceid": "a8b4b139-0089-425a-b673-11beed785afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 25 04:45:36.091703 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Releasing lock "refresh_cache-520409fb-f97c-4503-b97b-7cecd377102a" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:45:36.099010 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Start _get_guest_xml network_info=[{"id": "a8b4b139-0089-425a-b673-11beed785afd", "address": "fa:16:3e:59:ff:77", "network": {"id": "520b6853-4209-4e41-a303-5ca3ef4f0b30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1265554160-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eaed0d81f16d469ba74297ae650cdd5d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b4b139-00", "ovs_interfaceid": "a8b4b139-0089-425a-b673-11beed785afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '4ecaf199-c1b9-4ce3-869c-178c170c1662'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:45:36.108219 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:45:36.110616 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-108048533', uuid='e4a08308-60a9-4414-a985-e92f46b5894c'), owner=OwnerMeta(userid='0fa107a6cc1b436694275db759f6e50d', username='tempest-ServerActionsTestOtherB-553771601-project-member', projectid='eaed0d81f16d469ba74297ae650cdd5d', projectname='tempest-ServerActionsTestOtherB-553771601'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a8b4b139-0089-425a-b673-11beed785afd", "address": "fa:16:3e:59:ff:77", "network": {"id": "520b6853-4209-4e41-a303-5ca3ef4f0b30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1265554160-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eaed0d81f16d469ba74297ae650cdd5d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b4b139-00", "ovs_interfaceid": "a8b4b139-0089-425a-b673-11beed785afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362736.109847) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:45:36.114860 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:45:36.114860 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:45:36.116844 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:45:36.117888 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:45:36.121507 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:45:36.121912 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:45:36.122578 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:45:36.122578 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:45:36.122578 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:45:36.122578 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:45:36.122578 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:45:36.122578 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:45:36.122930 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:45:36.122930 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:45:36.123024 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:45:36.123224 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:45:36.147767 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-108048533',display_name='tempest-ServerActionsTestOtherB-server-108048533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-serveractionstestotherb-server-108048533',id=26,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQCVUPP0LXwk1uAo+tvPcSW3Q0BEdTrIlkkFhrWsD3IdY1FQHrZ7w/AjGwLjvCNQ7PCRtwP2Z8mOOqHpHs61+KzvVnqcDA2tePYYNA2zE8iUDXK4Rb1WW++pVqAwavoSg==',key_name='tempest-keypair-673892523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaed0d81f16d469ba74297ae650cdd5d',ramdisk_id='',reservation_id='r-56hogohq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-553771601',owner_user_name='tempest-ServerActionsTestOtherB-553771601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fa107a6cc1b436694275db759f6e50d',uuid=e4a08308-60a9-4414-a985-e92f46b5894c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8b4b139-0089-425a-b673-11beed785afd", "address": "fa:16:3e:59:ff:77", "network": {"id": "520b6853-4209-4e41-a303-5ca3ef4f0b30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1265554160-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eaed0d81f16d469ba74297ae650cdd5d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b4b139-00", "ovs_interfaceid": "a8b4b139-0089-425a-b673-11beed785afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:45:36.147767 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Converting VIF {"id": "a8b4b139-0089-425a-b673-11beed785afd", "address": "fa:16:3e:59:ff:77", "network": {"id": "520b6853-4209-4e41-a303-5ca3ef4f0b30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1265554160-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eaed0d81f16d469ba74297ae650cdd5d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b4b139-00", "ovs_interfaceid": "a8b4b139-0089-425a-b673-11beed785afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:45:36.149779 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:ff:77,bridge_name='br-int',has_traffic_filtering=True,id=a8b4b139-0089-425a-b673-11beed785afd,network=Network(520b6853-4209-4e41-a303-5ca3ef4f0b30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8b4b139-00') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:45:36.150879 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Lazy-loading 'pci_devices' on Instance uuid e4a08308-60a9-4414-a985-e92f46b5894c {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:36.255021 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] During sync_power_state the instance has a pending task (unrescuing). Skip. Jun 25 04:45:36.343018 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-be1993b3-b679-4e76-a3f4-aab2b7c358e2 tempest-VolumesBackupsTest-84947449 tempest-VolumesBackupsTest-84947449-project-member] Lock "2082d17e-c724-40c9-b1d2-b8a9c9a5d2d2" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.693s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:36.523383 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-3edd2c95-31c7-4caf-b373-3adff6d93ccb tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:36.558890 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-d1621e92-4af7-4ac6-95f7-387286c99aa3 req-f7cfa3e9-4270-4ef8-9b83-42272b8be561 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:36.609757 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.80', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003587', 'execute': None}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:45:36.623492 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.scaleio [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98952) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 25 04:45:36.644549 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Calling os-brick to attach iSCSI Volume {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 25 04:45:36.644923 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953', 'iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a5030d5-9c33-4b30-8838-af5f1bf37953', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:45:36.645207 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:45:36.645611 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:45:36.646043 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953', 'iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a5030d5-9c33-4b30-8838-af5f1bf37953', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] End _get_guest_xml xml= Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: e4a08308-60a9-4414-a985-e92f46b5894c Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: instance-0000001a Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: 196608 Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: tempest-ServerActionsTestOtherB-server-108048533 Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: 2026-06-25 04:45:36 Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: 192 Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: 0 Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: 0 Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: True Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: bare Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: 0 Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: virtio Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: tempest-ServerActionsTestOtherB-553771601-project-member Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: tempest-ServerActionsTestOtherB-553771601 Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: e4a08308-60a9-4414-a985-e92f46b5894c Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: e4a08308-60a9-4414-a985-e92f46b5894c Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: hvm Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: 128 Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Preparing to wait for external event network-vif-plugged-a8b4b139-0089-425a-b673-11beed785afd {{(pid=98952) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 25 04:45:36.656169 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Acquiring lock "e4a08308-60a9-4414-a985-e92f46b5894c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:36.662450 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Lock "e4a08308-60a9-4414-a985-e92f46b5894c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:36.662450 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Lock "e4a08308-60a9-4414-a985-e92f46b5894c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:36.662450 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-25T04:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-108048533',display_name='tempest-ServerActionsTestOtherB-server-108048533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-serveractionstestotherb-server-108048533',id=26,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQCVUPP0LXwk1uAo+tvPcSW3Q0BEdTrIlkkFhrWsD3IdY1FQHrZ7w/AjGwLjvCNQ7PCRtwP2Z8mOOqHpHs61+KzvVnqcDA2tePYYNA2zE8iUDXK4Rb1WW++pVqAwavoSg==',key_name='tempest-keypair-673892523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaed0d81f16d469ba74297ae650cdd5d',ramdisk_id='',reservation_id='r-56hogohq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-553771601',owner_user_name='tempest-ServerActionsTestOtherB-553771601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fa107a6cc1b436694275db759f6e50d',uuid=e4a08308-60a9-4414-a985-e92f46b5894c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8b4b139-0089-425a-b673-11beed785afd", "address": "fa:16:3e:59:ff:77", "network": {"id": "520b6853-4209-4e41-a303-5ca3ef4f0b30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1265554160-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eaed0d81f16d469ba74297ae650cdd5d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b4b139-00", "ovs_interfaceid": "a8b4b139-0089-425a-b673-11beed785afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:45:36.662450 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Converting VIF {"id": "a8b4b139-0089-425a-b673-11beed785afd", "address": "fa:16:3e:59:ff:77", "network": {"id": "520b6853-4209-4e41-a303-5ca3ef4f0b30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1265554160-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eaed0d81f16d469ba74297ae650cdd5d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b4b139-00", "ovs_interfaceid": "a8b4b139-0089-425a-b673-11beed785afd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:45:36.662450 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:ff:77,bridge_name='br-int',has_traffic_filtering=True,id=a8b4b139-0089-425a-b673-11beed785afd,network=Network(520b6853-4209-4e41-a303-5ca3ef4f0b30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8b4b139-00') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:45:36.662450 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:ff:77,bridge_name='br-int',has_traffic_filtering=True,id=a8b4b139-0089-425a-b673-11beed785afd,network=Network(520b6853-4209-4e41-a303-5ca3ef4f0b30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8b4b139-00') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:45:36.662450 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:36.663221 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:36.665137 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): nvme version {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:36.666773 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:45:36.669663 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:45:36.671421 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:36.671781 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d85f590-17f8-5ec4-a38a-ff7743bbd789', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:36.676591 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:36.679111 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:45:36.701653 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.020s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:45:36.701653 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:45:36.702705 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.033s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:45:36.703105 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:45:36.714105 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:45:36.729032 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:45:36.729032 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:36.732444 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 25 04:45:36.732444 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:36.734097 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:36.735462 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] 'nvme version' failed. Not Retrying. {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 04:45:36.735462 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8b4b139-00, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:36.737004 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] nvme not present on system {{(pid=98952) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 25 04:45:36.742438 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8b4b139-00, col_values=(('qos', UUID('4bbc73d0-6c21-430f-a256-715ff12c2a44')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:36.742438 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8b4b139-00, col_values=(('external_ids', {'iface-id': 'a8b4b139-0089-425a-b673-11beed785afd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:ff:77', 'vm-uuid': 'e4a08308-60a9-4414-a985-e92f46b5894c'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:36.744455 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:45:36.754023 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:36.757425 np0000003587 nova-compute[98952]: INFO os_vif [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:ff:77,bridge_name='br-int',has_traffic_filtering=True,id=a8b4b139-0089-425a-b673-11beed785afd,network=Network(520b6853-4209-4e41-a303-5ca3ef4f0b30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8b4b139-00') Jun 25 04:45:36.760026 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953] added Jun 25 04:45:36.760026 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:45:36.760026 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:45:36.760026 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:45:36.760026 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:45:36.760026 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:45:36.760026 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:36.760416 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953] added Jun 25 04:45:36.760416 np0000003587 nova-compute[98952]: stderr=iscsiadm: Config file line 363 does not have value Jun 25 04:45:36.760416 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:45:36.760416 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:45:36.760416 np0000003587 nova-compute[98952]: iscsiadm: Config file line 363 does not have value Jun 25 04:45:36.760416 np0000003587 nova-compute[98952]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 25 04:45:36.760416 np0000003587 nova-compute[98952]: {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:36.761718 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98952) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 25 04:45:36.763491 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:45:36.764248 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98952) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 25 04:45:36.764833 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.lightos [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Current host hostNQN and IP(s) are ['10.4.3.80', 'fe80::f816:3eff:feea:dfe4', '192.168.40.6', 'fe80::f816:3eff:fe4f:7c42', '192.168.50.6', 'fe80::f816:3eff:fe6c:e6a6', '192.168.10.6', 'fe80::f816:3eff:fe17:d749', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::b035:28ff:fe70:6f4a', 'fe80::fc16:3eff:fe78:7ac8', 'fe80::1038:1dff:fe1c:d44b', 'fe80::fc16:3eff:fe3a:4858', 'fe80::fc16:3eff:fe4f:4083', 'fe80::fc16:3eff:fe54:f058', 'fe80::c80b:26ff:fea1:f17c', 'fe80::fc16:3eff:fe5a:f24b', 'fe80::6c47:21ff:fe4b:e2cc', 'fe80::fc16:3eff:fe57:c07f', 'fe80::fc16:3eff:fe01:4b19', 'fe80::c096:18ff:fe44:3261', 'fe80::9031:12ff:fefb:c0b2', 'fe80::fc16:3eff:fef5:86eb', 'fe80::38d3:89ff:fe81:f241', 'fe80::fc16:3eff:fe32:f4b4', 'fe80::fc16:3eff:fe87:35c5', 'fe80::28f9:9eff:feb8:4ca3', 'fe80::fc16:3eff:fe59:7dcd'] Jun 25 04:45:36.765384 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0627(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:45:36.765759 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0615(s), this was the 1st time calling it. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 25 04:45:36.766043 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:45:36.766190 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 25 04:45:36.766358 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98952) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 25 04:45:36.766476 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.lightos [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] LIGHTOS: no hostnqn found. {{(pid=98952) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 25 04:45:36.766746 np0000003587 nova-compute[98952]: DEBUG os_brick.utils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.80', 'host': 'np0000003587', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c81886224652', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a1feb13-40e2-4ac6-989e-b08a6fc0f283', 'nvme_native_multipath': False} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:45:36.839305 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-3edd2c95-31c7-4caf-b373-3adff6d93ccb tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Updating instance_info_cache with network_info: [{"id": "4a601377-1147-4c58-9ff9-5fb6c1610844", "address": "fa:16:3e:59:7d:cd", "network": {"id": "06c0ad47-4541-470f-826b-31e1b541d27e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-265899561-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c14752bebb0420a9c82e4049038bcc3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a601377-11", "ovs_interfaceid": "4a601377-1147-4c58-9ff9-5fb6c1610844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:45:36.965314 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-a632933d-7105-4301-a965-264e22b256b8 req-7efb98a9-b3b7-4501-a969-063df2a0872e service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Received event network-changed-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:36.965498 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-a632933d-7105-4301-a965-264e22b256b8 req-7efb98a9-b3b7-4501-a969-063df2a0872e service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Refreshing instance network info cache due to event network-changed-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:45:36.965777 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a632933d-7105-4301-a965-264e22b256b8 req-7efb98a9-b3b7-4501-a969-063df2a0872e service nova] Acquiring lock "refresh_cache-8b915629-823e-4b55-bc64-d73e58b79bdc" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:45:37.091826 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-d1621e92-4af7-4ac6-95f7-387286c99aa3 req-f7cfa3e9-4270-4ef8-9b83-42272b8be561 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:37.319737 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-d1621e92-4af7-4ac6-95f7-387286c99aa3 req-f7cfa3e9-4270-4ef8-9b83-42272b8be561 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Updated VIF entry in instance network info cache for port 4ea2b8f9-a162-4e7a-a47a-0683ae39bacf. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:45:37.319737 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-d1621e92-4af7-4ac6-95f7-387286c99aa3 req-f7cfa3e9-4270-4ef8-9b83-42272b8be561 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Updating instance_info_cache with network_info: [{"id": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "address": "fa:16:3e:01:4b:19", "network": {"id": "42b56fcf-0521-41b0-90c0-19763fa22d07", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-808831530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "531c29726a504313bae3835b93c9c5eb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea2b8f9-a1", "ovs_interfaceid": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:45:37.343977 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-3edd2c95-31c7-4caf-b373-3adff6d93ccb tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Releasing lock "refresh_cache-e6afb3ec-b48f-4dd6-95a1-d3c097b5203c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:45:37.344661 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-3edd2c95-31c7-4caf-b373-3adff6d93ccb tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lazy-loading 'flavor' on Instance uuid e6afb3ec-b48f-4dd6-95a1-d3c097b5203c {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:37.601725 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquiring lock "8b915629-823e-4b55-bc64-d73e58b79bdc" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:37.601978 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:37.766752 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:45:37.767329 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.40.100 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:45:37.780833 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.startup = manual Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.scan = auto Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.50.100 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:45:37.789822 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:37.797394 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:37.804063 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:37.818209 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:37.818209 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:37.818209 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:37.818209 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:37.818209 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:37.818209 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:37.818209 np0000003587 nova-compute[98952]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:37.818209 np0000003587 nova-compute[98952]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:37.818209 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:45:37.818599 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:37.818599 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:37.818599 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:37.818599 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:37.818599 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:37.818599 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:37.818599 np0000003587 nova-compute[98952]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:37.818599 np0000003587 nova-compute[98952]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:37.818599 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:45:37.822788 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d1621e92-4af7-4ac6-95f7-387286c99aa3 req-f7cfa3e9-4270-4ef8-9b83-42272b8be561 service nova] Releasing lock "refresh_cache-8b915629-823e-4b55-bc64-d73e58b79bdc" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:45:37.823355 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a632933d-7105-4301-a965-264e22b256b8 req-7efb98a9-b3b7-4501-a969-063df2a0872e service nova] Acquired lock "refresh_cache-8b915629-823e-4b55-bc64-d73e58b79bdc" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:45:37.823999 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:37.823999 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:37.823999 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:37.823999 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:37.823999 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:37.823999 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:37.823999 np0000003587 nova-compute[98952]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:37.823999 np0000003587 nova-compute[98952]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:37.823999 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:45:37.824240 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-a632933d-7105-4301-a965-264e22b256b8 req-7efb98a9-b3b7-4501-a969-063df2a0872e service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Refreshing network info cache for port 4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:45:37.825306 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:37.825306 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:37.825306 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:37.825306 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:37.825306 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:37.825306 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:37.825306 np0000003587 nova-compute[98952]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:37.825306 np0000003587 nova-compute[98952]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:37.825306 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:45:37.876471 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953, portal: 192.168.40.100,3260] Jun 25 04:45:37.876471 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953, portal: 192.168.40.100,3260] successful. Jun 25 04:45:37.876471 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:37.876934 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953, portal: 192.168.50.100,3260] Jun 25 04:45:37.876934 np0000003587 nova-compute[98952]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953, portal: 192.168.50.100,3260] successful. Jun 25 04:45:37.876934 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:37.891898 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:37.893990 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:37.904008 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:37.904008 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:37.918177 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:37.918177 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:37.918177 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:37.918177 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:37.918177 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:37.918177 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:37.918177 np0000003587 nova-compute[98952]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:37.918177 np0000003587 nova-compute[98952]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:37.918177 np0000003587 nova-compute[98952]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953 (non-flash) Jun 25 04:45:37.918177 np0000003587 nova-compute[98952]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953 (non-flash) Jun 25 04:45:37.918177 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:45:37.918785 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:37.918785 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:37.918785 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:37.918785 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:37.918785 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:37.918785 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:37.918785 np0000003587 nova-compute[98952]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:37.918785 np0000003587 nova-compute[98952]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:37.918785 np0000003587 nova-compute[98952]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953 (non-flash) Jun 25 04:45:37.918785 np0000003587 nova-compute[98952]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953 (non-flash) Jun 25 04:45:37.918785 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:45:37.918785 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.216s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:45:37.924004 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Connected to 192.168.40.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:45:37.924819 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:37.924819 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:37.924819 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:37.924819 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:37.924819 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:37.924819 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:37.924819 np0000003587 nova-compute[98952]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:37.924819 np0000003587 nova-compute[98952]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:37.924819 np0000003587 nova-compute[98952]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953 (non-flash) Jun 25 04:45:37.924819 np0000003587 nova-compute[98952]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953 (non-flash) Jun 25 04:45:37.924819 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:45:37.925058 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:37.925058 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:37.925058 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:37.925058 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:37.925058 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:37.925058 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:37.925058 np0000003587 nova-compute[98952]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:37.925058 np0000003587 nova-compute[98952]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:37.925058 np0000003587 nova-compute[98952]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953 (non-flash) Jun 25 04:45:37.925058 np0000003587 nova-compute[98952]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953 (non-flash) Jun 25 04:45:37.925058 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:45:37.925411 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.226s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:45:37.925998 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Connected to 192.168.50.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:45:37.929354 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:37.931890 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] HCTL ('14', '-', '-', 0) found on session 44 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:45:37.932148 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:45:37.933054 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] HCTL ('13', '-', '-', 0) found on session 43 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:45:37.933400 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:45:37.951839 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Searching for a device in session 43 and hctl ['13', '*', '*', 0] yield: None {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:45:37.953685 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Searching for a device in session 44 and hctl ['14', '*', '*', 0] yield: sdh {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:45:37.953685 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4a5030d5-9c33-4b30-8838-af5f1bf37953', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:45:37.980204 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Starting finish_migration {{(pid=98952) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12808}} Jun 25 04:45:37.981708 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Instance directory exists: not creating {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}} Jun 25 04:45:37.981708 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Creating image(s) Jun 25 04:45:37.982565 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:38.090933 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-59dc37cf-863a-40ac-a786-327a6d01713b req-f75c487d-c3f4-4dca-9330-cb11ef1f8976 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Received event network-vif-unplugged-4a601377-1147-4c58-9ff9-5fb6c1610844 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:38.091115 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-59dc37cf-863a-40ac-a786-327a6d01713b req-f75c487d-c3f4-4dca-9330-cb11ef1f8976 service nova] Acquiring lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:38.091383 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-59dc37cf-863a-40ac-a786-327a6d01713b req-f75c487d-c3f4-4dca-9330-cb11ef1f8976 service nova] Lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:38.091529 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-59dc37cf-863a-40ac-a786-327a6d01713b req-f75c487d-c3f4-4dca-9330-cb11ef1f8976 service nova] Lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:38.093374 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-59dc37cf-863a-40ac-a786-327a6d01713b req-f75c487d-c3f4-4dca-9330-cb11ef1f8976 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] No waiting events found dispatching network-vif-unplugged-4a601377-1147-4c58-9ff9-5fb6c1610844 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:38.093698 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-59dc37cf-863a-40ac-a786-327a6d01713b req-f75c487d-c3f4-4dca-9330-cb11ef1f8976 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Received unexpected event network-vif-unplugged-4a601377-1147-4c58-9ff9-5fb6c1610844 for instance with vm_state rescued and task_state unrescuing. Jun 25 04:45:38.095210 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:38.096340 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e5aba596f5fec82a3fe9ee64fcaac16d43f94f4 --force-share --output=json" returned: 0 in 0.114s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:38.096754 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Checking if we can resize image /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk. size=1073741824 {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 25 04:45:38.097025 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:38.112446 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Detaching volume 25f2f478-abf9-45a5-8377-8af2524b83dd Jun 25 04:45:38.122712 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:38.184009 np0000003587 nova-compute[98952]: INFO nova.virt.block_device [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Attempting to driver detach volume 25f2f478-abf9-45a5-8377-8af2524b83dd from mountpoint /dev/vdb Jun 25 04:45:38.193940 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Found disk vdb by alias ua-25f2f478-abf9-45a5-8377-8af2524b83dd {{(pid=98952) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 25 04:45:38.195485 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Found disk vdb by alias ua-25f2f478-abf9-45a5-8377-8af2524b83dd {{(pid=98952) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 25 04:45:38.195650 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Attempting to detach device vdb from instance 8b915629-823e-4b55-bc64-d73e58b79bdc from the persistent domain config. {{(pid=98952) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 25 04:45:38.196100 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] detach device xml: Jun 25 04:45:38.196100 np0000003587 nova-compute[98952]: Jun 25 04:45:38.196100 np0000003587 nova-compute[98952]: Jun 25 04:45:38.196100 np0000003587 nova-compute[98952]: Jun 25 04:45:38.196100 np0000003587 nova-compute[98952]: Jun 25 04:45:38.196100 np0000003587 nova-compute[98952]: 25f2f478-abf9-45a5-8377-8af2524b83dd Jun 25 04:45:38.196100 np0000003587 nova-compute[98952]:
Jun 25 04:45:38.196100 np0000003587 nova-compute[98952]: Jun 25 04:45:38.196100 np0000003587 nova-compute[98952]: {{(pid=98952) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 25 04:45:38.201963 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:38.202728 np0000003587 nova-compute[98952]: DEBUG nova.virt.disk.api [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Cannot resize image /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk to a smaller size. {{(pid=98952) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 25 04:45:38.214241 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Successfully detached device vdb from instance 8b915629-823e-4b55-bc64-d73e58b79bdc from the persistent domain config. Jun 25 04:45:38.214750 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] (1/8): Attempting to detach device vdb with device alias ua-25f2f478-abf9-45a5-8377-8af2524b83dd from instance 8b915629-823e-4b55-bc64-d73e58b79bdc from the live domain config. {{(pid=98952) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 25 04:45:38.217475 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] detach device xml: Jun 25 04:45:38.217475 np0000003587 nova-compute[98952]: Jun 25 04:45:38.217475 np0000003587 nova-compute[98952]: Jun 25 04:45:38.217475 np0000003587 nova-compute[98952]: Jun 25 04:45:38.217475 np0000003587 nova-compute[98952]: Jun 25 04:45:38.217475 np0000003587 nova-compute[98952]: 25f2f478-abf9-45a5-8377-8af2524b83dd Jun 25 04:45:38.217475 np0000003587 nova-compute[98952]:
Jun 25 04:45:38.217475 np0000003587 nova-compute[98952]: Jun 25 04:45:38.217475 np0000003587 nova-compute[98952]: {{(pid=98952) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 25 04:45:38.237033 np0000003587 nova-compute[98952]: DEBUG nova.utils [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Queued Task(fn=>, remaining_delay=14.999685058000068 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:38.238659 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Instance destroyed successfully. Jun 25 04:45:38.239188 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-3edd2c95-31c7-4caf-b373-3adff6d93ccb tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lazy-loading 'numa_topology' on Instance uuid e6afb3ec-b48f-4dd6-95a1-d3c097b5203c {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:38.288473 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:45:38.288613 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:45:38.288718 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] No VIF found with MAC fa:16:3e:59:ff:77, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:45:38.289146 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Using config drive Jun 25 04:45:38.327039 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-a632933d-7105-4301-a965-264e22b256b8 req-7efb98a9-b3b7-4501-a969-063df2a0872e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:38.659667 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-a632933d-7105-4301-a965-264e22b256b8 req-7efb98a9-b3b7-4501-a969-063df2a0872e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:38.708383 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Did not create local disks {{(pid=98952) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 25 04:45:38.708527 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Ensure instance console log exists: /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/console.log {{(pid=98952) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 25 04:45:38.708828 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:38.709002 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:38.709155 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:38.711515 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Start _get_guest_xml network_info=[{"id": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "address": "fa:16:3e:55:5b:09", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "vif_mac": "fa:16:3e:55:5b:09"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa967a2fd-f8", "ovs_interfaceid": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encrypted': False, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'image_id': '4ecaf199-c1b9-4ce3-869c-178c170c1662'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '520409fb-f97c-4503-b97b-7cecd377102a', 'attached_at': '2026-06-25T04:45:37.000000', 'detached_at': '', 'volume_id': '89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'multiattach': True, 'serial': '89748225-9d41-4fb1-b47a-f0f88aa6ebfa'}, 'attachment_id': '5d3979ed-895e-4158-a6fa-f7b02324ba69', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 25 04:45:38.715130 np0000003587 nova-compute[98952]: WARNING nova.virt.libvirt.driver [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 25 04:45:38.716697 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4ecaf199-c1b9-4ce3-869c-178c170c1662', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='520409fb-f97c-4503-b97b-7cecd377102a'), owner=OwnerMeta(userid='947bde0e827c45f5bab008d094816d8c', username='tempest-AttachVolumeMultiAttachTest-1256899935-project-member', projectid='284d191aa82f453cabcfd18172f74099', projectname='tempest-AttachVolumeMultiAttachTest-1256899935'), image=ImageMeta(id='4ecaf199-c1b9-4ce3-869c-178c170c1662', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "address": "fa:16:3e:55:5b:09", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "vif_mac": "fa:16:3e:55:5b:09"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa967a2fd-f8", "ovs_interfaceid": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782362738.716182) {{(pid=98952) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 25 04:45:38.720888 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V1... {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 25 04:45:38.721421 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CPU controller missing on host. {{(pid=98952) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 25 04:45:38.722531 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching host: 'np0000003587' for CPU controller through CGroups V2... {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 25 04:45:38.722801 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CPU controller found on host. {{(pid=98952) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 25 04:45:38.724013 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98952) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 25 04:45:38.724718 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-25T04:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-25T04:38:57Z,direct_url=,disk_format='qcow2',id=4ecaf199-c1b9-4ce3-869c-178c170c1662,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='18482c87fd2d42b5a2e76ff2d17204d0',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-25T04:39:00Z,virtual_size=,visibility=), allow threads: True {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 25 04:45:38.724951 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Flavor limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 25 04:45:38.725135 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Image limits 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 25 04:45:38.725362 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Flavor pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 25 04:45:38.725540 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Image pref 0:0:0 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 25 04:45:38.725733 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 25 04:45:38.725969 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 25 04:45:38.726160 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 25 04:45:38.726359 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Got 1 possible topologies {{(pid=98952) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 25 04:45:38.726539 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 25 04:45:38.726747 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98952) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 25 04:45:38.742797 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-3edd2c95-31c7-4caf-b373-3adff6d93ccb tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Object Instance lazy-loaded attributes: flavor,numa_topology {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:45:38.743569 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk.config --force-share --output=json {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:38.797546 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:38.832844 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk.config --force-share --output=json" returned: 0 in 0.089s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:38.833384 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "/opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:38.833646 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "/opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:38.834270 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "/opt/stack/data/nova/instances/520409fb-f97c-4503-b97b-7cecd377102a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:38.834773 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Calling os-brick to attach iSCSI Volume {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 25 04:45:38.835406 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:45:38.835629 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:45:38.872549 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-a632933d-7105-4301-a965-264e22b256b8 req-7efb98a9-b3b7-4501-a969-063df2a0872e service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Updated VIF entry in instance network info cache for port 4ea2b8f9-a162-4e7a-a47a-0683ae39bacf. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:45:38.872885 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-a632933d-7105-4301-a965-264e22b256b8 req-7efb98a9-b3b7-4501-a969-063df2a0872e service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Updating instance_info_cache with network_info: [{"id": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "address": "fa:16:3e:01:4b:19", "network": {"id": "42b56fcf-0521-41b0-90c0-19763fa22d07", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-808831530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "531c29726a504313bae3835b93c9c5eb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea2b8f9-a1", "ovs_interfaceid": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:45:38.899925 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Received event ua-25f2f478-abf9-45a5-8377-8af2524b83dd> from libvirt while the driver is waiting for it; dispatched. {{(pid=98952) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 25 04:45:38.903681 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-25f2f478-abf9-45a5-8377-8af2524b83dd for instance 8b915629-823e-4b55-bc64-d73e58b79bdc {{(pid=98952) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 25 04:45:38.907322 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Successfully detached device vdb from instance 8b915629-823e-4b55-bc64-d73e58b79bdc from the live domain config. Jun 25 04:45:38.908677 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] calling os-brick to detach iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 25 04:45:38.908958 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25f2f478-abf9-45a5-8377-8af2524b83dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:45:38.909091 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:45:38.952699 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Searching for a device in session 43 and hctl ['13', '*', '*', 0] yield: sdi {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:45:38.952918 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a5030d5-9c33-4b30-8838-af5f1bf37953', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:45:38.991479 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Creating config drive at /opt/stack/data/nova/instances/e4a08308-60a9-4414-a985-e92f46b5894c/disk.config Jun 25 04:45:38.997276 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e4a08308-60a9-4414-a985-e92f46b5894c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgfffk_0u {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 04:45:39.059214 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.processutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e4a08308-60a9-4414-a985-e92f46b5894c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgfffk_0u" returned: 0 in 0.061s {{(pid=98952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 04:45:39.376008 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-a632933d-7105-4301-a965-264e22b256b8 req-7efb98a9-b3b7-4501-a969-063df2a0872e service nova] Releasing lock "refresh_cache-8b915629-823e-4b55-bc64-d73e58b79bdc" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:45:39.690932 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:39.721190 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Found WWN 3300000001c754102 for multipath device dm-5 {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 25 04:45:39.722061 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.076s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:45:39.722061 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] <== connect_volume: return (3077ms) {'type': 'block', 'scsi_wwn': '3300000001c754102', 'path': '/dev/dm-5', 'multipath_id': '3300000001c754102'} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:45:39.722285 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001c754102', 'path': '/dev/dm-5', 'multipath_id': '3300000001c754102'} {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 25 04:45:39.723159 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.887s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:45:39.723861 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 25 04:45:39.728303 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:39.733100 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lazy-loading 'flavor' on Instance uuid d0e9b114-f17b-4b1e-b8e1-b1a821f38974 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:39.742378 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:45:39.742839 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:45:39.743031 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 25 04:45:39.746187 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:45:39.746187 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:45:39.746187 np0000003587 nova-compute[98952]: INFO os_brick.initiator.connectors.iscsi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.startup = automatic Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.scan = manual Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.40.100 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:45:39.758783 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.name = iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.tpgt = -1 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.startup = automatic Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.leading_login = No Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.iscsi_ifacename = default Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.net_ifacename = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.ipaddress = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.prefix_len = 0 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.hwaddress = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.transport_name = tcp Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.initiatorname = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.state = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.vlan_id = 0 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.vlan_priority = 0 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.vlan_state = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.iface_num = 0 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.mtu = 0 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.port = 0 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.bootproto = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.subnet_mask = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.gateway = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id_state = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.dhcp_alt_client_id = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.dhcp_dns = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.dhcp_learn_iqn = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.dhcp_req_vendor_id_state = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id_state = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.dhcp_vendor_id = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.dhcp_slp_da = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.fragmentation = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.gratuitous_arp = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.incoming_forwarding = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.tos_state = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.tos = 0 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.ttl = 0 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.delayed_ack = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.tcp_nagle = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.tcp_wsf_state = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.tcp_wsf = 0 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.tcp_timer_scale = 0 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.tcp_timestamp = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.redirect = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.def_task_mgmt_timeout = 0 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.header_digest = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.data_digest = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.immediate_data = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.initial_r2t = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.data_seq_inorder = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.data_pdu_inorder = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.erl = 0 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.max_receive_data_len = 0 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.first_burst_len = 0 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.max_outstanding_r2t = 0 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.max_burst_len = 0 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.chap_auth = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.bidi_chap = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.strict_login_compliance = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.discovery_auth = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: iface.discovery_logout = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.discovery_address = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.discovery_port = 0 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.discovery_type = fw Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.initial_cmdsn = 0 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.initial_login_retry_max = 8 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.xmit_thread_priority = 0 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.cmds_max = 128 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.queue_depth = 32 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.nr_sessions = 1 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.auth.authmethod = None Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.auth.username = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.auth.password = *** Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.auth.username_in = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.auth.password_in = Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.auth.chap_algs = SHA256 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.timeo.replacement_timeout = 120 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.err_timeo.abort_timeout = 15 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.err_timeo.lu_reset_timeout = 30 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.err_timeo.host_reset_timeout = 60 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.iscsi.FastAbort = Yes Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.iscsi.InitialR2T = No Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.iscsi.ImmediateData = Yes Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.iscsi.FirstBurstLength = 262144 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.iscsi.MaxBurstLength = 16776192 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Retain = 0 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.iscsi.DefaultTime2Wait = 2 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.iscsi.MaxConnections = 1 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.iscsi.ERL = 0 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.scan = manual Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.session.reopen_max = 0 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.conn[0].address = 192.168.50.100 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.conn[0].port = 3260 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.conn[0].startup = manual Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.conn[0].tcp.window_size = 524288 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.conn[0].tcp.type_of_service = 0 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.conn[0].timeo.logout_timeout = 15 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.conn[0].timeo.login_timeout = 15 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.conn[0].timeo.auth_timeout = 45 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_interval = 5 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.conn[0].timeo.noop_out_timeout = 5 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.conn[0].iscsi.HeaderDigest = None Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.conn[0].iscsi.DataDigest = None Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.conn[0].iscsi.IFMarker = No Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: node.conn[0].iscsi.OFMarker = No Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: # END RECORD Jun 25 04:45:39.765284 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:39.773722 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:39.781013 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:39.795787 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:39.795787 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:39.795787 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:39.795787 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:39.795787 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:39.795787 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:39.795787 np0000003587 nova-compute[98952]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:39.795787 np0000003587 nova-compute[98952]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:39.795787 np0000003587 nova-compute[98952]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953 (non-flash) Jun 25 04:45:39.795787 np0000003587 nova-compute[98952]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953 (non-flash) Jun 25 04:45:39.795787 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:45:39.796219 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:39.796219 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:39.796219 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:39.796219 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:39.796219 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:39.796219 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:39.796219 np0000003587 nova-compute[98952]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:39.796219 np0000003587 nova-compute[98952]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:39.796219 np0000003587 nova-compute[98952]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953 (non-flash) Jun 25 04:45:39.796219 np0000003587 nova-compute[98952]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953 (non-flash) Jun 25 04:45:39.796219 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:45:39.796569 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.053s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:45:39.796569 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to 192.168.40.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:45:39.802801 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] HCTL ('28', '0', '0', 0) found on session 34 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:45:39.803059 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Scanning host 28 c: 0, t: 0, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:45:39.804399 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:39.804399 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:39.804399 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:39.804399 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:39.804399 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:39.804399 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:39.804399 np0000003587 nova-compute[98952]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:39.804399 np0000003587 nova-compute[98952]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:39.804399 np0000003587 nova-compute[98952]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953 (non-flash) Jun 25 04:45:39.804399 np0000003587 nova-compute[98952]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953 (non-flash) Jun 25 04:45:39.804399 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:45:39.804624 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:39.804624 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:39.804624 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:39.804624 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:39.804624 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:39.804624 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:39.804624 np0000003587 nova-compute[98952]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:39.804624 np0000003587 nova-compute[98952]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:39.804624 np0000003587 nova-compute[98952]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953 (non-flash) Jun 25 04:45:39.804624 np0000003587 nova-compute[98952]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953 (non-flash) Jun 25 04:45:39.804624 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:45:39.804973 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.060s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:45:39.805073 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to 192.168.50.100:3260 {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 25 04:45:39.808502 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] HCTL ('27', '0', '0', 0) found on session 33 with lun 0 {{(pid=98952) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 25 04:45:39.808672 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Scanning host 27 c: 0, t: 0, l: 0) {{(pid=98952) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 25 04:45:39.816338 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching for a device in session 34 and hctl ('28', '0', '0', 0) yield: sdw {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:45:39.816600 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to sdw using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:45:39.818918 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Searching for a device in session 33 and hctl ('27', '0', '0', 0) yield: sdv {{(pid=98952) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 25 04:45:39.819053 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Connected to sdv using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '89748225-9d41-4fb1-b47a-f0f88aa6ebfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98952) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 25 04:45:39.850246 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:39.879693 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:39.882146 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:39.887973 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:39.944642 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:40.050121 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:40.075815 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:40.185863 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-927ef8aa-7895-409c-a392-f6f95083beda req-efd2d26e-ca76-4053-a9ee-36d63284a5f7 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Received event network-vif-unplugged-4a601377-1147-4c58-9ff9-5fb6c1610844 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:40.185863 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-927ef8aa-7895-409c-a392-f6f95083beda req-efd2d26e-ca76-4053-a9ee-36d63284a5f7 service nova] Acquiring lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:40.185863 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-927ef8aa-7895-409c-a392-f6f95083beda req-efd2d26e-ca76-4053-a9ee-36d63284a5f7 service nova] Lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:40.185981 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-927ef8aa-7895-409c-a392-f6f95083beda req-efd2d26e-ca76-4053-a9ee-36d63284a5f7 service nova] Lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:40.186143 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-927ef8aa-7895-409c-a392-f6f95083beda req-efd2d26e-ca76-4053-a9ee-36d63284a5f7 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] No waiting events found dispatching network-vif-unplugged-4a601377-1147-4c58-9ff9-5fb6c1610844 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:40.186309 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-927ef8aa-7895-409c-a392-f6f95083beda req-efd2d26e-ca76-4053-a9ee-36d63284a5f7 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Received unexpected event network-vif-unplugged-4a601377-1147-4c58-9ff9-5fb6c1610844 for instance with vm_state rescued and task_state unrescuing. Jun 25 04:45:40.186435 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-927ef8aa-7895-409c-a392-f6f95083beda req-efd2d26e-ca76-4053-a9ee-36d63284a5f7 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Received event network-vif-plugged-4a601377-1147-4c58-9ff9-5fb6c1610844 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:40.186594 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-927ef8aa-7895-409c-a392-f6f95083beda req-efd2d26e-ca76-4053-a9ee-36d63284a5f7 service nova] Acquiring lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:40.186751 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-927ef8aa-7895-409c-a392-f6f95083beda req-efd2d26e-ca76-4053-a9ee-36d63284a5f7 service nova] Lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:40.186929 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-927ef8aa-7895-409c-a392-f6f95083beda req-efd2d26e-ca76-4053-a9ee-36d63284a5f7 service nova] Lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:40.187054 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-927ef8aa-7895-409c-a392-f6f95083beda req-efd2d26e-ca76-4053-a9ee-36d63284a5f7 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] No waiting events found dispatching network-vif-plugged-4a601377-1147-4c58-9ff9-5fb6c1610844 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:40.187118 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-927ef8aa-7895-409c-a392-f6f95083beda req-efd2d26e-ca76-4053-a9ee-36d63284a5f7 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Received unexpected event network-vif-plugged-4a601377-1147-4c58-9ff9-5fb6c1610844 for instance with vm_state rescued and task_state unrescuing. Jun 25 04:45:40.240025 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Attempting to attach volume 4a5030d5-9c33-4b30-8838-af5f1bf37953 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98952) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 25 04:45:40.241377 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] attach device xml: Jun 25 04:45:40.241377 np0000003587 nova-compute[98952]: Jun 25 04:45:40.241377 np0000003587 nova-compute[98952]: Jun 25 04:45:40.241377 np0000003587 nova-compute[98952]: Jun 25 04:45:40.241377 np0000003587 nova-compute[98952]: Jun 25 04:45:40.241377 np0000003587 nova-compute[98952]: 4a5030d5-9c33-4b30-8838-af5f1bf37953 Jun 25 04:45:40.241377 np0000003587 nova-compute[98952]: Jun 25 04:45:40.241377 np0000003587 nova-compute[98952]: {{(pid=98952) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 25 04:45:40.282488 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:40.285962 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:40.293293 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:40.294728 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:40.315631 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:40.649732 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0010322480000013456 future=) was cancelled during its delay period, skipping {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:40.650082 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:40.650082 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=4.203773297999987 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:40.650082 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=4.203703929999847 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:40.745710 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 25 04:45:40.826337 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.host [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Removed pending STOPPED event for e6afb3ec-b48f-4dd6-95a1-d3c097b5203c due to new event Resumed> {{(pid=98952) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 25 04:45:40.826590 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:45:40.826673 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] VM Resumed (Lifecycle Event) Jun 25 04:45:40.829071 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-3edd2c95-31c7-4caf-b373-3adff6d93ccb tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:41.330100 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:41.332636 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:45:41.742548 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:41.759971 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Found WWN 330000000a5c943c3 for multipath device dm-18 {{(pid=98952) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 25 04:45:41.760371 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.037s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:45:41.760564 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] <== connect_volume: return (2924ms) {'type': 'block', 'scsi_wwn': '330000000a5c943c3', 'path': '/dev/dm-18', 'multipath_id': '330000000a5c943c3'} {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:45:41.760719 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a5c943c3', 'path': '/dev/dm-18', 'multipath_id': '330000000a5c943c3'} {{(pid=98952) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 25 04:45:41.761996 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.852s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:45:41.761996 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25f2f478-abf9-45a5-8377-8af2524b83dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 25 04:45:41.761996 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', 0)] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953 (non-flash) Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953 (non-flash) Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd (non-flash) Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953 (non-flash) Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953 (non-flash) Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953', '44')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', '40')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd', '39')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Resulting device map defaultdict(. at 0x7a16b81b2980>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd'): ({'sdf'}, set())}) {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Removing multipathed devices sdf, sdg {{(pid=98952) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 25 04:45:41.798867 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Flush multipath device 33000000019fbaf06 {{(pid=98952) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 25 04:45:41.835277 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:45:41.835494 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] VM Started (Lifecycle Event) Jun 25 04:45:41.837103 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:45:41.892524 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:45:41.918077 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:45:41.918323 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:45:41.918418 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] No VIF found with MAC fa:16:3e:54:f0:58, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:45:41.953890 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 25 04:45:41.953890 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 25 04:45:41.953890 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 25 04:45:41.965469 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 25 04:45:41.965469 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd')] {{(pid=98952) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 25 04:45:41.977163 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:42.013928 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd, portal: 192.168.40.100,3260] Jun 25 04:45:42.013928 np0000003587 nova-compute[98952]: Logout of [sid: 40, target: iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd, portal: 192.168.40.100,3260] successful. Jun 25 04:45:42.013928 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:42.033154 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:42.043621 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:42.079773 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd, portal: 192.168.50.100,3260] Jun 25 04:45:42.079773 np0000003587 nova-compute[98952]: Logout of [sid: 39, target: iqn.2023-03.storpool.com:os--volume-25f2f478-abf9-45a5-8377-8af2524b83dd, portal: 192.168.50.100,3260] successful. Jun 25 04:45:42.079773 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:42.102585 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:42.102585 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:45:42.102585 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] <== disconnect_volume: return (3191ms) None {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:45:42.102585 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Disconnected iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 25 04:45:42.251728 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d49bdba2-3a6e-414e-9a00-467ffbcb56a2 req-31f54fbd-c9a1-414e-9b99-82f03a6793b2 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Received event network-vif-plugged-4a601377-1147-4c58-9ff9-5fb6c1610844 {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:42.255190 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d49bdba2-3a6e-414e-9a00-467ffbcb56a2 req-31f54fbd-c9a1-414e-9b99-82f03a6793b2 service nova] Acquiring lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:42.255416 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d49bdba2-3a6e-414e-9a00-467ffbcb56a2 req-31f54fbd-c9a1-414e-9b99-82f03a6793b2 service nova] Lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:42.255542 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d49bdba2-3a6e-414e-9a00-467ffbcb56a2 req-31f54fbd-c9a1-414e-9b99-82f03a6793b2 service nova] Lock "e6afb3ec-b48f-4dd6-95a1-d3c097b5203c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:42.255712 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d49bdba2-3a6e-414e-9a00-467ffbcb56a2 req-31f54fbd-c9a1-414e-9b99-82f03a6793b2 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] No waiting events found dispatching network-vif-plugged-4a601377-1147-4c58-9ff9-5fb6c1610844 {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:42.255837 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-d49bdba2-3a6e-414e-9a00-467ffbcb56a2 req-31f54fbd-c9a1-414e-9b99-82f03a6793b2 service nova] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Received unexpected event network-vif-plugged-4a601377-1147-4c58-9ff9-5fb6c1610844 for instance with vm_state active and task_state None. Jun 25 04:45:42.255965 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d49bdba2-3a6e-414e-9a00-467ffbcb56a2 req-31f54fbd-c9a1-414e-9b99-82f03a6793b2 service nova] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Received event network-vif-plugged-a8b4b139-0089-425a-b673-11beed785afd {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:42.256118 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d49bdba2-3a6e-414e-9a00-467ffbcb56a2 req-31f54fbd-c9a1-414e-9b99-82f03a6793b2 service nova] Acquiring lock "e4a08308-60a9-4414-a985-e92f46b5894c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:42.256270 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d49bdba2-3a6e-414e-9a00-467ffbcb56a2 req-31f54fbd-c9a1-414e-9b99-82f03a6793b2 service nova] Lock "e4a08308-60a9-4414-a985-e92f46b5894c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:42.256426 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d49bdba2-3a6e-414e-9a00-467ffbcb56a2 req-31f54fbd-c9a1-414e-9b99-82f03a6793b2 service nova] Lock "e4a08308-60a9-4414-a985-e92f46b5894c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:42.256604 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d49bdba2-3a6e-414e-9a00-467ffbcb56a2 req-31f54fbd-c9a1-414e-9b99-82f03a6793b2 service nova] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Processing event network-vif-plugged-a8b4b139-0089-425a-b673-11beed785afd {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 25 04:45:42.256767 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d49bdba2-3a6e-414e-9a00-467ffbcb56a2 req-31f54fbd-c9a1-414e-9b99-82f03a6793b2 service nova] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Received event network-vif-plugged-a8b4b139-0089-425a-b673-11beed785afd {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:42.256930 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d49bdba2-3a6e-414e-9a00-467ffbcb56a2 req-31f54fbd-c9a1-414e-9b99-82f03a6793b2 service nova] Acquiring lock "e4a08308-60a9-4414-a985-e92f46b5894c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:42.257077 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d49bdba2-3a6e-414e-9a00-467ffbcb56a2 req-31f54fbd-c9a1-414e-9b99-82f03a6793b2 service nova] Lock "e4a08308-60a9-4414-a985-e92f46b5894c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:42.257203 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-d49bdba2-3a6e-414e-9a00-467ffbcb56a2 req-31f54fbd-c9a1-414e-9b99-82f03a6793b2 service nova] Lock "e4a08308-60a9-4414-a985-e92f46b5894c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:42.257345 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-d49bdba2-3a6e-414e-9a00-467ffbcb56a2 req-31f54fbd-c9a1-414e-9b99-82f03a6793b2 service nova] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] No waiting events found dispatching network-vif-plugged-a8b4b139-0089-425a-b673-11beed785afd {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:42.257473 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-d49bdba2-3a6e-414e-9a00-467ffbcb56a2 req-31f54fbd-c9a1-414e-9b99-82f03a6793b2 service nova] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Received unexpected event network-vif-plugged-a8b4b139-0089-425a-b673-11beed785afd for instance with vm_state building and task_state spawning. Jun 25 04:45:42.258025 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:45:42.260710 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Guest created on hypervisor {{(pid=98952) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 25 04:45:42.263057 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Instance spawned successfully. Jun 25 04:45:42.264120 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 25 04:45:42.266648 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:43:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000003587',hostname='multiattach-server-1',id=19,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV/p3ZeuUk+pDtRyjEqB6LGacp/8M+rMj60nbQpQu7IIRoy9lFRhD1vsgSIFDZ+PjS4ytFpGVQZ3frW+0uH/J+qnA92sFXepo+od7tCOydqRChW2tpsraqZi+iIk6G08A==',key_name='tempest-keypair-462979399',keypairs=,launch_index=0,launched_at=2026-06-25T04:43:53Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003587',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='284d191aa82f453cabcfd18172f74099',ramdisk_id='',reservation_id='r-tn9kc6s5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1256899935',owner_user_name='tempest-AttachVolumeMultiAttachTest-1256899935-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='947bde0e827c45f5bab008d094816d8c',uuid=520409fb-f97c-4503-b97b-7cecd377102a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "address": "fa:16:3e:55:5b:09", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "vif_mac": "fa:16:3e:55:5b:09"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa967a2fd-f8", "ovs_interfaceid": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:45:42.266871 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converting VIF {"id": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "address": "fa:16:3e:55:5b:09", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "vif_mac": "fa:16:3e:55:5b:09"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa967a2fd-f8", "ovs_interfaceid": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:45:42.267578 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:5b:09,bridge_name='br-int',has_traffic_filtering=True,id=a967a2fd-f804-4a2d-b980-fae0336ab02c,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa967a2fd-f8') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] End _get_guest_xml xml= Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: 520409fb-f97c-4503-b97b-7cecd377102a Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: instance-00000013 Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: 262144 Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: multiattach-server-1 Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: 2026-06-25 04:45:38 Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: 256 Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: 0 Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: 0 Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: True Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: bare Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: 0 Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: ide Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: virtio Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: pc Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: virtio Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: virtio Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: virtio Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: tempest-AttachVolumeMultiAttachTest-1256899935-project-member Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: tempest-AttachVolumeMultiAttachTest-1256899935 Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: 520409fb-f97c-4503-b97b-7cecd377102a Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: 520409fb-f97c-4503-b97b-7cecd377102a Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: hvm Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: 128 Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: 89748225-9d41-4fb1-b47a-f0f88aa6ebfa Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: /dev/urandom Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: Jun 25 04:45:42.269899 np0000003587 nova-compute[98952]: {{(pid=98952) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 25 04:45:42.272997 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:43:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000003587',hostname='multiattach-server-1',id=19,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV/p3ZeuUk+pDtRyjEqB6LGacp/8M+rMj60nbQpQu7IIRoy9lFRhD1vsgSIFDZ+PjS4ytFpGVQZ3frW+0uH/J+qnA92sFXepo+od7tCOydqRChW2tpsraqZi+iIk6G08A==',key_name='tempest-keypair-462979399',keypairs=,launch_index=0,launched_at=2026-06-25T04:43:53Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003587',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='284d191aa82f453cabcfd18172f74099',ramdisk_id='',reservation_id='r-tn9kc6s5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1256899935',owner_user_name='tempest-AttachVolumeMultiAttachTest-1256899935-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-25T04:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='947bde0e827c45f5bab008d094816d8c',uuid=520409fb-f97c-4503-b97b-7cecd377102a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "address": "fa:16:3e:55:5b:09", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "vif_mac": "fa:16:3e:55:5b:09"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa967a2fd-f8", "ovs_interfaceid": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 25 04:45:42.272997 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converting VIF {"id": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "address": "fa:16:3e:55:5b:09", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "vif_mac": "fa:16:3e:55:5b:09"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa967a2fd-f8", "ovs_interfaceid": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:45:42.272997 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:5b:09,bridge_name='br-int',has_traffic_filtering=True,id=a967a2fd-f804-4a2d-b980-fae0336ab02c,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa967a2fd-f8') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:45:42.272997 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:5b:09,bridge_name='br-int',has_traffic_filtering=True,id=a967a2fd-f804-4a2d-b980-fae0336ab02c,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa967a2fd-f8') {{(pid=98952) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 25 04:45:42.272997 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:42.272997 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:42.272997 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 25 04:45:42.274913 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:42.275216 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '875c2cc3-b882-528c-b2d7-e536192fbdc1', '_type': 'linux-noop'}}, row=False) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:42.286200 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:42.286983 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:45:42.287744 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:42.289422 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:42.289584 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa967a2fd-f8, may_exist=True, interface_attrs={}) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:42.289867 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa967a2fd-f8, col_values=(('qos', UUID('7267972a-0b7a-4720-86fd-562e09260f6c')),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:42.290042 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa967a2fd-f8, col_values=(('external_ids', {'iface-id': 'a967a2fd-f804-4a2d-b980-fae0336ab02c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:5b:09', 'vm-uuid': '520409fb-f97c-4503-b97b-7cecd377102a'}),), if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:42.291006 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:42.292134 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:45:42.296698 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:42.297546 np0000003587 nova-compute[98952]: INFO os_vif [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:5b:09,bridge_name='br-int',has_traffic_filtering=True,id=a967a2fd-f804-4a2d-b980-fae0336ab02c,network=Network(2123f113-c403-432d-8543-2dbf3dbb8081),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa967a2fd-f8') Jun 25 04:45:42.338621 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:42.344980 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e6afb3ec-b48f-4dd6-95a1-d3c097b5203c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:45:42.679077 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lazy-loading 'flavor' on Instance uuid 8b915629-823e-4b55-bc64-d73e58b79bdc {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:42.770442 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Found default for hw_cdrom_bus of ide {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:45:42.770865 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Found default for hw_disk_bus of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:45:42.770919 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Found default for hw_input_bus of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:45:42.771200 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Found default for hw_pointer_model of None {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:45:42.771485 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Found default for hw_video_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:45:42.771829 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Found default for hw_vif_model of virtio {{(pid=98952) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 25 04:45:42.847306 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:45:42.847481 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] VM Started (Lifecycle Event) Jun 25 04:45:43.277501 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Took 9.77 seconds to spawn the instance on the hypervisor. Jun 25 04:45:43.277714 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:43.351117 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:43.354187 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:45:43.472589 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-d67dba0b-1596-4b10-ab8d-465f4ef839a9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.629s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:43.692755 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-fc9f6a94-5d5c-4bac-9ef5-634783e1e1e4 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 6.091s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:43.793398 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Took 15.83 seconds to build instance. Jun 25 04:45:43.816168 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name vda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:45:43.816168 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:45:43.816168 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No BDM found with device name hda, not building metadata. {{(pid=98952) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 25 04:45:43.816168 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] No VIF found with MAC fa:16:3e:55:5b:09, not building metadata {{(pid=98952) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 25 04:45:43.816168 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Using config drive Jun 25 04:45:43.857896 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Paused> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:45:43.857896 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] VM Paused (Lifecycle Event) Jun 25 04:45:44.282381 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:44.297939 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-1e4f844e-ecf8-4a04-bbe6-a320155f6a5e tempest-ServerActionsTestOtherB-553771601 tempest-ServerActionsTestOtherB-553771601-project-member] Lock "e4a08308-60a9-4414-a985-e92f46b5894c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.345s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:44.310781 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:44.315411 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:44.360617 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:44.366934 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:45:44.367114 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] VM Resumed (Lifecycle Event) Jun 25 04:45:44.450830 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:44.505795 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:44.724630 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-c5aebe2b-8eac-441a-8149-e1fbc338c600 req-a997461c-b36a-437f-99af-265b8cf5eea4 service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Received event network-vif-plugged-a967a2fd-f804-4a2d-b980-fae0336ab02c {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:44.724891 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-c5aebe2b-8eac-441a-8149-e1fbc338c600 req-a997461c-b36a-437f-99af-265b8cf5eea4 service nova] Acquiring lock "520409fb-f97c-4503-b97b-7cecd377102a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:44.725127 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-c5aebe2b-8eac-441a-8149-e1fbc338c600 req-a997461c-b36a-437f-99af-265b8cf5eea4 service nova] Lock "520409fb-f97c-4503-b97b-7cecd377102a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:44.725262 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-c5aebe2b-8eac-441a-8149-e1fbc338c600 req-a997461c-b36a-437f-99af-265b8cf5eea4 service nova] Lock "520409fb-f97c-4503-b97b-7cecd377102a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:44.725389 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-c5aebe2b-8eac-441a-8149-e1fbc338c600 req-a997461c-b36a-437f-99af-265b8cf5eea4 service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] No waiting events found dispatching network-vif-plugged-a967a2fd-f804-4a2d-b980-fae0336ab02c {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:44.725507 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-c5aebe2b-8eac-441a-8149-e1fbc338c600 req-a997461c-b36a-437f-99af-265b8cf5eea4 service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Received unexpected event network-vif-plugged-a967a2fd-f804-4a2d-b980-fae0336ab02c for instance with vm_state active and task_state resize_finish. Jun 25 04:45:44.854310 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005933550000918331 future=) submitted to {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:44.855017 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] Emitting event Stopped> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:45:44.856116 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] VM Stopped (Lifecycle Event) Jun 25 04:45:44.859355 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:44.859355 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=8.377614427000026 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:44.859355 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=8.377452647000155 future=) was cancelled while queued, skipping {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:44.859355 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:44.871429 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:44.879906 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:45:45.053543 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:45.310724 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Acquiring lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:45.313716 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-36a556ca-cf44-4971-a01c-e4f31b5fda76 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquiring lock "8b915629-823e-4b55-bc64-d73e58b79bdc" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:45.314040 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-36a556ca-cf44-4971-a01c-e4f31b5fda76 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.003s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:45.314380 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:45.315547 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-36a556ca-cf44-4971-a01c-e4f31b5fda76 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquiring lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:45.315745 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-36a556ca-cf44-4971-a01c-e4f31b5fda76 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.002s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:45.315896 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-36a556ca-cf44-4971-a01c-e4f31b5fda76 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:45.321435 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-36a556ca-cf44-4971-a01c-e4f31b5fda76 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Terminating instance Jun 25 04:45:45.362315 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-5cd814c2-20ad-4619-970d-4e8e17d38440 tempest-ServerBootFromVolumeStableRescueTest-6878904 tempest-ServerBootFromVolumeStableRescueTest-6878904-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:45.434027 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Resumed> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:45:45.434166 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] VM Resumed (Lifecycle Event) Jun 25 04:45:45.435620 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Instance event wait completed in 0 seconds for {{(pid=98952) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 25 04:45:45.438307 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Instance running successfully. Jun 25 04:45:45.440709 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Failed to set time: agent not configured {{(pid=98952) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}} Jun 25 04:45:45.440839 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-1067de7f-bed0-4bce-8f65-979e11a629e3 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] finish_migration finished successfully. {{(pid=98952) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12903}} Jun 25 04:45:45.767034 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-0f5b4db7-c6f2-4e99-a50e-7eb7869db02c tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquiring lock "c95cb835-b2ba-43d4-b7cf-fa1dbacd07c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:45.767239 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-0f5b4db7-c6f2-4e99-a50e-7eb7869db02c tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "c95cb835-b2ba-43d4-b7cf-fa1dbacd07c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:45.819683 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Detaching volume 4a5030d5-9c33-4b30-8838-af5f1bf37953 Jun 25 04:45:45.830761 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-36a556ca-cf44-4971-a01c-e4f31b5fda76 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Start destroying the instance on the hypervisor. {{(pid=98952) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 25 04:45:45.859581 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:45.869520 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:45.897235 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:45.901301 np0000003587 nova-compute[98952]: INFO nova.virt.block_device [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Attempting to driver detach volume 4a5030d5-9c33-4b30-8838-af5f1bf37953 from mountpoint /dev/vdb Jun 25 04:45:45.910573 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:45.912835 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Found disk vdb by alias ua-4a5030d5-9c33-4b30-8838-af5f1bf37953 {{(pid=98952) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 25 04:45:45.914864 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Found disk vdb by alias ua-4a5030d5-9c33-4b30-8838-af5f1bf37953 {{(pid=98952) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 25 04:45:45.915024 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Attempting to detach device vdb from instance d0e9b114-f17b-4b1e-b8e1-b1a821f38974 from the persistent domain config. {{(pid=98952) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 25 04:45:45.915315 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] detach device xml: Jun 25 04:45:45.915315 np0000003587 nova-compute[98952]: Jun 25 04:45:45.915315 np0000003587 nova-compute[98952]: Jun 25 04:45:45.915315 np0000003587 nova-compute[98952]: Jun 25 04:45:45.915315 np0000003587 nova-compute[98952]: Jun 25 04:45:45.915315 np0000003587 nova-compute[98952]: 4a5030d5-9c33-4b30-8838-af5f1bf37953 Jun 25 04:45:45.915315 np0000003587 nova-compute[98952]:
Jun 25 04:45:45.915315 np0000003587 nova-compute[98952]: Jun 25 04:45:45.915315 np0000003587 nova-compute[98952]: {{(pid=98952) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 25 04:45:45.924727 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Successfully detached device vdb from instance d0e9b114-f17b-4b1e-b8e1-b1a821f38974 from the persistent domain config. Jun 25 04:45:45.925742 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] (1/8): Attempting to detach device vdb with device alias ua-4a5030d5-9c33-4b30-8838-af5f1bf37953 from instance d0e9b114-f17b-4b1e-b8e1-b1a821f38974 from the live domain config. {{(pid=98952) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 25 04:45:45.925742 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] detach device xml: Jun 25 04:45:45.925742 np0000003587 nova-compute[98952]: Jun 25 04:45:45.925742 np0000003587 nova-compute[98952]: Jun 25 04:45:45.925742 np0000003587 nova-compute[98952]: Jun 25 04:45:45.925742 np0000003587 nova-compute[98952]: Jun 25 04:45:45.925742 np0000003587 nova-compute[98952]: 4a5030d5-9c33-4b30-8838-af5f1bf37953 Jun 25 04:45:45.925742 np0000003587 nova-compute[98952]:
Jun 25 04:45:45.925742 np0000003587 nova-compute[98952]: Jun 25 04:45:45.925742 np0000003587 nova-compute[98952]: {{(pid=98952) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 25 04:45:45.938805 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:45.944626 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:45.946623 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:45:46.109033 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-657c79b9-2533-4126-8902-03893e57e726 req-ee30aa46-704f-4256-af1a-4eabf2ce2900 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Received event network-vif-unplugged-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:46.109033 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-657c79b9-2533-4126-8902-03893e57e726 req-ee30aa46-704f-4256-af1a-4eabf2ce2900 service nova] Acquiring lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:46.109033 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-657c79b9-2533-4126-8902-03893e57e726 req-ee30aa46-704f-4256-af1a-4eabf2ce2900 service nova] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:46.109033 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-657c79b9-2533-4126-8902-03893e57e726 req-ee30aa46-704f-4256-af1a-4eabf2ce2900 service nova] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:46.109033 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-657c79b9-2533-4126-8902-03893e57e726 req-ee30aa46-704f-4256-af1a-4eabf2ce2900 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] No waiting events found dispatching network-vif-unplugged-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:46.109033 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-657c79b9-2533-4126-8902-03893e57e726 req-ee30aa46-704f-4256-af1a-4eabf2ce2900 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Received event network-vif-unplugged-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:45:46.179779 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:46.193407 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:46.226276 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [-] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Instance destroyed successfully. Jun 25 04:45:46.227653 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-36a556ca-cf44-4971-a01c-e4f31b5fda76 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lazy-loading 'resources' on Instance uuid 8b915629-823e-4b55-bc64-d73e58b79bdc {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:46.271272 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-0f5b4db7-c6f2-4e99-a50e-7eb7869db02c tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: c95cb835-b2ba-43d4-b7cf-fa1dbacd07c9] Starting instance... {{(pid=98952) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 25 04:45:46.451760 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] During sync_power_state the instance has a pending task (resize_finish). Skip. Jun 25 04:45:46.455117 np0000003587 nova-compute[98952]: DEBUG nova.virt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Emitting event Started> {{(pid=98952) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 25 04:45:46.455117 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] VM Started (Lifecycle Event) Jun 25 04:45:46.731809 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-36a556ca-cf44-4971-a01c-e4f31b5fda76 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:43:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1333554901',display_name='tempest-TestMinimumBasicScenario-server-1333554901',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-testminimumbasicscenario-server-1333554901',id=20,image_ref='40ab5d2e-8009-4416-96e0-288079826d15',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIMUjcAKLuJ8eQl8//dID0PBJnmyDvj8jV4j3W/51m7kOma0OarvCuVUgOW43HLUNFw2LvTlSfrfcVQOCz1xrYEidkPoXOARpDdyQfAk+vzyNMGN6jSf5rU9xJ0u0BLPg==',key_name='tempest-TestMinimumBasicScenario-1094476213',keypairs=,launch_index=0,launched_at=2026-06-25T04:43:59Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='531c29726a504313bae3835b93c9c5eb',ramdisk_id='',reservation_id='r-unbq8o10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='40ab5d2e-8009-4416-96e0-288079826d15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-653303651',owner_user_name='tempest-TestMinimumBasicScenario-653303651-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:44:57Z,user_data=None,user_id='b5f65ec37e8e4f43aea1ab1bb0aa3552',uuid=8b915629-823e-4b55-bc64-d73e58b79bdc,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "address": "fa:16:3e:01:4b:19", "network": {"id": "42b56fcf-0521-41b0-90c0-19763fa22d07", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-808831530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "531c29726a504313bae3835b93c9c5eb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea2b8f9-a1", "ovs_interfaceid": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 25 04:45:46.732047 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-36a556ca-cf44-4971-a01c-e4f31b5fda76 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Converting VIF {"id": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "address": "fa:16:3e:01:4b:19", "network": {"id": "42b56fcf-0521-41b0-90c0-19763fa22d07", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-808831530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "531c29726a504313bae3835b93c9c5eb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea2b8f9-a1", "ovs_interfaceid": "4ea2b8f9-a162-4e7a-a47a-0683ae39bacf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:45:46.732621 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-36a556ca-cf44-4971-a01c-e4f31b5fda76 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:4b:19,bridge_name='br-int',has_traffic_filtering=True,id=4ea2b8f9-a162-4e7a-a47a-0683ae39bacf,network=Network(42b56fcf-0521-41b0-90c0-19763fa22d07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea2b8f9-a1') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:45:46.732848 np0000003587 nova-compute[98952]: DEBUG os_vif [None req-36a556ca-cf44-4971-a01c-e4f31b5fda76 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:4b:19,bridge_name='br-int',has_traffic_filtering=True,id=4ea2b8f9-a162-4e7a-a47a-0683ae39bacf,network=Network(42b56fcf-0521-41b0-90c0-19763fa22d07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea2b8f9-a1') {{(pid=98952) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 25 04:45:46.737846 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:46.738089 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ea2b8f9-a1, bridge=br-int, if_exists=True) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:46.740575 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:45:46.742744 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:46.743396 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:46.744428 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=919bc51f-e598-4c2c-af8b-b51434c8a6b8) {{(pid=98952) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 25 04:45:46.745614 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:46.745967 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 25 04:45:46.748066 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:46.751910 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-4a5030d5-9c33-4b30-8838-af5f1bf37953 for instance d0e9b114-f17b-4b1e-b8e1-b1a821f38974 {{(pid=98952) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 25 04:45:46.752300 np0000003587 nova-compute[98952]: INFO os_vif [None req-36a556ca-cf44-4971-a01c-e4f31b5fda76 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:4b:19,bridge_name='br-int',has_traffic_filtering=True,id=4ea2b8f9-a162-4e7a-a47a-0683ae39bacf,network=Network(42b56fcf-0521-41b0-90c0-19763fa22d07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea2b8f9-a1') Jun 25 04:45:46.752649 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-36a556ca-cf44-4971-a01c-e4f31b5fda76 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Deleting instance files /opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc_del Jun 25 04:45:46.753677 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-36a556ca-cf44-4971-a01c-e4f31b5fda76 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Deletion of /opt/stack/data/nova/instances/8b915629-823e-4b55-bc64-d73e58b79bdc_del complete Jun 25 04:45:46.831241 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2c78928a-6353-4aae-b1ad-2d8825098a7e req-8f163277-5f85-437f-904d-19d7356ce28b service nova] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Received event network-changed-a8b4b139-0089-425a-b673-11beed785afd {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:46.831241 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2c78928a-6353-4aae-b1ad-2d8825098a7e req-8f163277-5f85-437f-904d-19d7356ce28b service nova] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Refreshing instance network info cache due to event network-changed-a8b4b139-0089-425a-b673-11beed785afd. {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 25 04:45:46.831633 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2c78928a-6353-4aae-b1ad-2d8825098a7e req-8f163277-5f85-437f-904d-19d7356ce28b service nova] Acquiring lock "refresh_cache-e4a08308-60a9-4414-a985-e92f46b5894c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:45:46.831633 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2c78928a-6353-4aae-b1ad-2d8825098a7e req-8f163277-5f85-437f-904d-19d7356ce28b service nova] Acquired lock "refresh_cache-e4a08308-60a9-4414-a985-e92f46b5894c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:45:46.832453 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-2c78928a-6353-4aae-b1ad-2d8825098a7e req-8f163277-5f85-437f-904d-19d7356ce28b service nova] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Refreshing network info cache for port a8b4b139-0089-425a-b673-11beed785afd {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 25 04:45:46.856943 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-0f5b4db7-c6f2-4e99-a50e-7eb7869db02c tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:46.856943 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-0f5b4db7-c6f2-4e99-a50e-7eb7869db02c tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:46.861336 np0000003587 nova-compute[98952]: DEBUG nova.virt.hardware [None req-0f5b4db7-c6f2-4e99-a50e-7eb7869db02c tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98952) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 25 04:45:46.861871 np0000003587 nova-compute[98952]: INFO nova.compute.claims [None req-0f5b4db7-c6f2-4e99-a50e-7eb7869db02c tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: c95cb835-b2ba-43d4-b7cf-fa1dbacd07c9] Claim successful on node np0000003587 Jun 25 04:45:46.958917 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Checking state {{(pid=98952) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 25 04:45:46.965452 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98952) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 25 04:45:47.144787 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4875844f-b88e-4b56-a9dd-6f7c852814f2 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "520409fb-f97c-4503-b97b-7cecd377102a" by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:47.145010 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4875844f-b88e-4b56-a9dd-6f7c852814f2 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lock "520409fb-f97c-4503-b97b-7cecd377102a" acquired by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:47.145220 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-4875844f-b88e-4b56-a9dd-6f7c852814f2 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Going to confirm migration 2 {{(pid=98952) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}} Jun 25 04:45:47.261777 np0000003587 nova-compute[98952]: INFO nova.compute.manager [None req-36a556ca-cf44-4971-a01c-e4f31b5fda76 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Took 1.43 seconds to destroy the instance on the hypervisor. Jun 25 04:45:47.262288 np0000003587 nova-compute[98952]: DEBUG oslo.service.backend._common.loopingcall [None req-36a556ca-cf44-4971-a01c-e4f31b5fda76 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98952) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 25 04:45:47.264739 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [-] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Deallocating network for instance {{(pid=98952) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 25 04:45:47.264739 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] deallocate_for_instance() {{(pid=98952) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 25 04:45:47.264739 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:47.336319 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:47.337367 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-2c78928a-6353-4aae-b1ad-2d8825098a7e req-8f163277-5f85-437f-904d-19d7356ce28b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:47.472751 np0000003587 nova-compute[98952]: DEBUG nova.utils [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Queued Task(fn=>, remaining_delay=14.999647676999984 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:47.473604 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-2d9262c9-3ee9-488a-87bf-c09ef8c15353 None None] Received event ua-4a5030d5-9c33-4b30-8838-af5f1bf37953> from libvirt while the driver is waiting for it; dispatched. {{(pid=98952) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 25 04:45:47.477680 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.996701111999982 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:47.477680 np0000003587 nova-compute[98952]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.996457231000022 future=) {{(pid=98952) _log /opt/stack/nova/nova/utils.py:1508}} Jun 25 04:45:47.478910 np0000003587 nova-compute[98952]: INFO nova.virt.libvirt.driver [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Successfully detached device vdb from instance d0e9b114-f17b-4b1e-b8e1-b1a821f38974 from the live domain config. Jun 25 04:45:47.486161 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] calling os-brick to detach iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 25 04:45:47.486161 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953', 'iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a5030d5-9c33-4b30-8838-af5f1bf37953', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 25 04:45:47.486161 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 25 04:45:47.486161 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 25 04:45:47.486516 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953', 'iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a5030d5-9c33-4b30-8838-af5f1bf37953', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 25 04:45:47.486516 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953', 0)] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 25 04:45:47.533437 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:47.533437 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:47.533437 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:47.533437 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:47.533437 np0000003587 nova-compute[98952]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:47.533437 np0000003587 nova-compute[98952]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:47.533437 np0000003587 nova-compute[98952]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953 (non-flash) Jun 25 04:45:47.533437 np0000003587 nova-compute[98952]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953 (non-flash) Jun 25 04:45:47.533437 np0000003587 nova-compute[98952]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6be3d775-a558-4f8f-b874-bacd84e6ace9 (non-flash) Jun 25 04:45:47.533437 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 25 04:45:47.533437 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:47.533437 np0000003587 nova-compute[98952]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:47.533437 np0000003587 nova-compute[98952]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa (non-flash) Jun 25 04:45:47.533437 np0000003587 nova-compute[98952]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232 (non-flash) Jun 25 04:45:47.533437 np0000003587 nova-compute[98952]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:47.533437 np0000003587 nova-compute[98952]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9 (non-flash) Jun 25 04:45:47.533437 np0000003587 nova-compute[98952]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953 (non-flash) Jun 25 04:45:47.533437 np0000003587 nova-compute[98952]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953 (non-flash) Jun 25 04:45:47.533437 np0000003587 nova-compute[98952]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6be3d775-a558-4f8f-b874-bacd84e6ace9 (non-flash) Jun 25 04:45:47.533437 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 25 04:45:47.533437 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89748225-9d41-4fb1-b47a-f0f88aa6ebfa', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-806b0e55-d716-447a-87d8-208a72ab2232', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ff12be7-cce2-435c-bba7-2b9802df56d9', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6be3d775-a558-4f8f-b874-bacd84e6ace9', '45')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 25 04:45:47.533437 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953', '43')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:45:47.536131 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953', '44')] {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 25 04:45:47.537452 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Resulting device map defaultdict(. at 0x7a16b85c1120>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953'): ({'sdh'}, set())}) {{(pid=98952) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 25 04:45:47.537722 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Removing multipathed devices sdh, sdi {{(pid=98952) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 25 04:45:47.538116 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Flush multipath device 3300000001c754102 {{(pid=98952) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 25 04:45:47.577807 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:45:47.626773 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98952) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 25 04:45:47.654034 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-4875844f-b88e-4b56-a9dd-6f7c852814f2 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:47.685900 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 25 04:45:47.685900 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98952) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 25 04:45:47.687670 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 25 04:45:47.702822 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.linuxscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98952) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 25 04:45:47.703122 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953')] {{(pid=98952) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 25 04:45:47.722735 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:47.768099 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953, portal: 192.168.40.100,3260] Jun 25 04:45:47.768099 np0000003587 nova-compute[98952]: Logout of [sid: 43, target: iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953, portal: 192.168.40.100,3260] successful. Jun 25 04:45:47.768099 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:47.808670 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:47.815174 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-4875844f-b88e-4b56-a9dd-6f7c852814f2 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:47.815464 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4875844f-b88e-4b56-a9dd-6f7c852814f2 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "refresh_cache-520409fb-f97c-4503-b97b-7cecd377102a" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 04:45:47.815928 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4875844f-b88e-4b56-a9dd-6f7c852814f2 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquired lock "refresh_cache-520409fb-f97c-4503-b97b-7cecd377102a" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 04:45:47.815928 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-4875844f-b88e-4b56-a9dd-6f7c852814f2 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Building network info cache for instance {{(pid=98952) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 25 04:45:47.818096 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-4875844f-b88e-4b56-a9dd-6f7c852814f2 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lazy-loading 'info_cache' on Instance uuid 520409fb-f97c-4503-b97b-7cecd377102a {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:47.835456 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:47.885114 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953, portal: 192.168.50.100,3260] Jun 25 04:45:47.885114 np0000003587 nova-compute[98952]: Logout of [sid: 44, target: iqn.2023-03.storpool.com:os--volume-4a5030d5-9c33-4b30-8838-af5f1bf37953, portal: 192.168.50.100,3260] successful. Jun 25 04:45:47.885114 np0000003587 nova-compute[98952]: stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:47.905296 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-4224a7a3-e16d-4082-a259-d25d03d2f60f req-dade0646-d1a8-4e15-ba84-b6237bab4b42 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Received event network-vif-deleted-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:47.905592 np0000003587 nova-compute[98952]: INFO nova.compute.manager [req-4224a7a3-e16d-4082-a259-d25d03d2f60f req-dade0646-d1a8-4e15-ba84-b6237bab4b42 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Neutron deleted interface 4ea2b8f9-a162-4e7a-a47a-0683ae39bacf; detaching it from the instance and deleting it from the info cache Jun 25 04:45:47.907951 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98952) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 25 04:45:47.907951 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.base [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 25 04:45:47.908242 np0000003587 nova-compute[98952]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] <== disconnect_volume: return (422ms) None {{(pid=98952) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 25 04:45:47.909176 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] [instance: d0e9b114-f17b-4b1e-b8e1-b1a821f38974] Disconnected iSCSI Volume {{(pid=98952) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 25 04:45:47.913670 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-4224a7a3-e16d-4082-a259-d25d03d2f60f req-dade0646-d1a8-4e15-ba84-b6237bab4b42 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Detach interface failed, port_id=4ea2b8f9-a162-4e7a-a47a-0683ae39bacf, reason: Instance 8b915629-823e-4b55-bc64-d73e58b79bdc could not be found. {{(pid=98952) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 25 04:45:47.938417 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [req-2c78928a-6353-4aae-b1ad-2d8825098a7e req-8f163277-5f85-437f-904d-19d7356ce28b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:48.162978 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-2c78928a-6353-4aae-b1ad-2d8825098a7e req-8f163277-5f85-437f-904d-19d7356ce28b service nova] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Updated VIF entry in instance network info cache for port a8b4b139-0089-425a-b673-11beed785afd. {{(pid=98952) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 25 04:45:48.165412 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [req-2c78928a-6353-4aae-b1ad-2d8825098a7e req-8f163277-5f85-437f-904d-19d7356ce28b service nova] [instance: e4a08308-60a9-4414-a985-e92f46b5894c] Updating instance_info_cache with network_info: [{"id": "a8b4b139-0089-425a-b673-11beed785afd", "address": "fa:16:3e:59:ff:77", "network": {"id": "520b6853-4209-4e41-a303-5ca3ef4f0b30", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1265554160-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eaed0d81f16d469ba74297ae650cdd5d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b4b139-00", "ovs_interfaceid": "a8b4b139-0089-425a-b673-11beed785afd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:45:48.199544 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-bfeca00f-c622-468b-baf1-ba42b91c9af1 req-95d85013-fda6-44d3-9622-e928d2424635 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Received event network-vif-unplugged-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:48.201358 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-bfeca00f-c622-468b-baf1-ba42b91c9af1 req-95d85013-fda6-44d3-9622-e928d2424635 service nova] Acquiring lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:48.201897 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-bfeca00f-c622-468b-baf1-ba42b91c9af1 req-95d85013-fda6-44d3-9622-e928d2424635 service nova] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:48.202105 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-bfeca00f-c622-468b-baf1-ba42b91c9af1 req-95d85013-fda6-44d3-9622-e928d2424635 service nova] Lock "8b915629-823e-4b55-bc64-d73e58b79bdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:48.202235 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-bfeca00f-c622-468b-baf1-ba42b91c9af1 req-95d85013-fda6-44d3-9622-e928d2424635 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] No waiting events found dispatching network-vif-unplugged-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:48.203157 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-bfeca00f-c622-468b-baf1-ba42b91c9af1 req-95d85013-fda6-44d3-9622-e928d2424635 service nova] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Received event network-vif-unplugged-4ea2b8f9-a162-4e7a-a47a-0683ae39bacf for instance with task_state deleting. {{(pid=98952) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 25 04:45:48.336644 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [-] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Updating instance_info_cache with network_info: [] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:45:48.504220 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lazy-loading 'flavor' on Instance uuid d0e9b114-f17b-4b1e-b8e1-b1a821f38974 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:48.667298 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2c78928a-6353-4aae-b1ad-2d8825098a7e req-8f163277-5f85-437f-904d-19d7356ce28b service nova] Releasing lock "refresh_cache-e4a08308-60a9-4414-a985-e92f46b5894c" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:45:48.669077 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2c78928a-6353-4aae-b1ad-2d8825098a7e req-8f163277-5f85-437f-904d-19d7356ce28b service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Received event network-vif-plugged-a967a2fd-f804-4a2d-b980-fae0336ab02c {{(pid=98952) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 25 04:45:48.669362 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2c78928a-6353-4aae-b1ad-2d8825098a7e req-8f163277-5f85-437f-904d-19d7356ce28b service nova] Acquiring lock "520409fb-f97c-4503-b97b-7cecd377102a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:48.669578 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2c78928a-6353-4aae-b1ad-2d8825098a7e req-8f163277-5f85-437f-904d-19d7356ce28b service nova] Lock "520409fb-f97c-4503-b97b-7cecd377102a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:48.669745 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [req-2c78928a-6353-4aae-b1ad-2d8825098a7e req-8f163277-5f85-437f-904d-19d7356ce28b service nova] Lock "520409fb-f97c-4503-b97b-7cecd377102a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:48.669898 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [req-2c78928a-6353-4aae-b1ad-2d8825098a7e req-8f163277-5f85-437f-904d-19d7356ce28b service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] No waiting events found dispatching network-vif-plugged-a967a2fd-f804-4a2d-b980-fae0336ab02c {{(pid=98952) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 25 04:45:48.670038 np0000003587 nova-compute[98952]: WARNING nova.compute.manager [req-2c78928a-6353-4aae-b1ad-2d8825098a7e req-8f163277-5f85-437f-904d-19d7356ce28b service nova] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Received unexpected event network-vif-plugged-a967a2fd-f804-4a2d-b980-fae0336ab02c for instance with vm_state resized and task_state None. Jun 25 04:45:48.808702 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-0f5b4db7-c6f2-4e99-a50e-7eb7869db02c tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98952) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 25 04:45:48.808992 np0000003587 nova-compute[98952]: DEBUG nova.compute.provider_tree [None req-0f5b4db7-c6f2-4e99-a50e-7eb7869db02c tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Inventory has not changed in ProviderTree for provider: e72c7643-c1ab-4c4d-a044-2b10e1a98687 {{(pid=98952) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 25 04:45:48.837132 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-4875844f-b88e-4b56-a9dd-6f7c852814f2 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:48.840459 np0000003587 nova-compute[98952]: INFO nova.compute.manager [-] [instance: 8b915629-823e-4b55-bc64-d73e58b79bdc] Took 1.58 seconds to deallocate network for instance. Jun 25 04:45:49.270339 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-4875844f-b88e-4b56-a9dd-6f7c852814f2 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:49.316040 np0000003587 nova-compute[98952]: DEBUG nova.scheduler.client.report [None req-0f5b4db7-c6f2-4e99-a50e-7eb7869db02c tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Inventory has not changed for provider e72c7643-c1ab-4c4d-a044-2b10e1a98687 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98952) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 25 04:45:49.349245 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-36a556ca-cf44-4971-a01c-e4f31b5fda76 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:49.444497 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-4875844f-b88e-4b56-a9dd-6f7c852814f2 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] [instance: 520409fb-f97c-4503-b97b-7cecd377102a] Updating instance_info_cache with network_info: [{"id": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "address": "fa:16:3e:55:5b:09", "network": {"id": "2123f113-c403-432d-8543-2dbf3dbb8081", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-750280511-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "284d191aa82f453cabcfd18172f74099", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa967a2fd-f8", "ovs_interfaceid": "a967a2fd-f804-4a2d-b980-fae0336ab02c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98952) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 25 04:45:49.679716 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-30deb590-575c-4bc2-b594-1fb4db0bfeef tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Acquiring lock "interface-d0e9b114-f17b-4b1e-b8e1-b1a821f38974-af0911e1-6cbd-42bf-aef4-7003f4f4e730" by "nova.compute.manager.ComputeManager.detach_interface..do_detach_interface" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:49.679909 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-30deb590-575c-4bc2-b594-1fb4db0bfeef tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "interface-d0e9b114-f17b-4b1e-b8e1-b1a821f38974-af0911e1-6cbd-42bf-aef4-7003f4f4e730" acquired by "nova.compute.manager.ComputeManager.detach_interface..do_detach_interface" :: waited 0.000s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:49.826407 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-0f5b4db7-c6f2-4e99-a50e-7eb7869db02c tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.969s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:49.827313 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-36a556ca-cf44-4971-a01c-e4f31b5fda76 tempest-TestMinimumBasicScenario-653303651 tempest-TestMinimumBasicScenario-653303651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.477s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 04:45:49.827533 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-0f5b4db7-c6f2-4e99-a50e-7eb7869db02c tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: c95cb835-b2ba-43d4-b7cf-fa1dbacd07c9] Start building networks asynchronously for instance. {{(pid=98952) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 25 04:45:49.947374 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4875844f-b88e-4b56-a9dd-6f7c852814f2 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Releasing lock "refresh_cache-520409fb-f97c-4503-b97b-7cecd377102a" {{(pid=98952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 04:45:49.947965 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-4875844f-b88e-4b56-a9dd-6f7c852814f2 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Lazy-loading 'migration_context' on Instance uuid 520409fb-f97c-4503-b97b-7cecd377102a {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:50.028040 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-bbe6f9df-e8c4-4678-aca1-233456de44c9 tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lock "d0e9b114-f17b-4b1e-b8e1-b1a821f38974" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 4.716s {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 04:45:50.057331 np0000003587 nova-compute[98952]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98952) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 25 04:45:50.185074 np0000003587 nova-compute[98952]: DEBUG nova.objects.instance [None req-30deb590-575c-4bc2-b594-1fb4db0bfeef tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Lazy-loading 'flavor' on Instance uuid d0e9b114-f17b-4b1e-b8e1-b1a821f38974 {{(pid=98952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 25 04:45:50.334273 np0000003587 nova-compute[98952]: DEBUG nova.compute.manager [None req-0f5b4db7-c6f2-4e99-a50e-7eb7869db02c tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: c95cb835-b2ba-43d4-b7cf-fa1dbacd07c9] Allocating IP information in the background. {{(pid=98952) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 25 04:45:50.334828 np0000003587 nova-compute[98952]: DEBUG nova.network.neutron [None req-0f5b4db7-c6f2-4e99-a50e-7eb7869db02c tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] [instance: c95cb835-b2ba-43d4-b7cf-fa1dbacd07c9] allocate_for_instance() {{(pid=98952) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 25 04:45:50.334828 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-0f5b4db7-c6f2-4e99-a50e-7eb7869db02c tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:50.335242 np0000003587 nova-compute[98952]: WARNING neutronclient.v2_0.client [None req-0f5b4db7-c6f2-4e99-a50e-7eb7869db02c tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 25 04:45:50.441877 np0000003587 nova-compute[98952]: DEBUG nova.policy [None req-0f5b4db7-c6f2-4e99-a50e-7eb7869db02c tempest-ServerRescueNegativeTestJSON-1184161043 tempest-ServerRescueNegativeTestJSON-1184161043-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ecbe28912a3b48e2b7c9023b1615e0cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14752bebb0420a9c82e4049038bcc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98952) authorize /opt/stack/nova/nova/policy.py:192}} Jun 25 04:45:50.451635 np0000003587 nova-compute[98952]: DEBUG nova.objects.base [None req-4875844f-b88e-4b56-a9dd-6f7c852814f2 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Object Instance<520409fb-f97c-4503-b97b-7cecd377102a> lazy-loaded attributes: info_cache,migration_context {{(pid=98952) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 25 04:45:50.466632 np0000003587 nova-compute[98952]: DEBUG oslo_concurrency.lockutils [None req-4875844f-b88e-4b56-a9dd-6f7c852814f2 tempest-AttachVolumeMultiAttachTest-1256899935 tempest-AttachVolumeMultiAttachTest-1256899935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 04:45:50.689312 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.vif [None req-30deb590-575c-4bc2-b594-1fb4db0bfeef tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-25T04:44:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-715977744',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003587',hostname='tempest-device-tagging-server-715977744',id=21,image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ31TiHTvkG1TqpPZ0eyA8zlJgWDgQ1Y4UudhVnxlIpmir8fEolbd1IR9P777kIxNtNGkwQxVlIHyNMjGJC34A1Z1juzVJx1D5ZrNzRanvOb0pRYxCKEEsRGPmuJwmfFVA==',key_name='tempest-keypair-1775299019',keypairs=,launch_index=0,launched_at=2026-06-25T04:44:42Z,launched_on='np0000003587',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003587',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='394c4d7e8a6f4b7e8fbefeb88f1f4022',ramdisk_id='',reservation_id='r-lkwtjldh',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ecaf199-c1b9-4ce3-869c-178c170c1662',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-9126716',owner_user_name='tempest-TaggedAttachmentsTest-9126716-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-06-25T04:44:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5da5f5d0548e4d11b82042832880176d',uuid=d0e9b114-f17b-4b1e-b8e1-b1a821f38974,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af0911e1-6cbd-42bf-aef4-7003f4f4e730", "address": "fa:16:3e:87:35:c5", "network": {"id": "260156eb-43c2-4baf-b4eb-6977b7f8121c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1779399057", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "394c4d7e8a6f4b7e8fbefeb88f1f4022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0911e1-6c", "ovs_interfaceid": "af0911e1-6cbd-42bf-aef4-7003f4f4e730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98952) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 25 04:45:50.689624 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-30deb590-575c-4bc2-b594-1fb4db0bfeef tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Converting VIF {"id": "af0911e1-6cbd-42bf-aef4-7003f4f4e730", "address": "fa:16:3e:87:35:c5", "network": {"id": "260156eb-43c2-4baf-b4eb-6977b7f8121c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1779399057", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "394c4d7e8a6f4b7e8fbefeb88f1f4022", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0911e1-6c", "ovs_interfaceid": "af0911e1-6cbd-42bf-aef4-7003f4f4e730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 25 04:45:50.691745 np0000003587 nova-compute[98952]: DEBUG nova.network.os_vif_util [None req-30deb590-575c-4bc2-b594-1fb4db0bfeef tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:35:c5,bridge_name='br-int',has_traffic_filtering=True,id=af0911e1-6cbd-42bf-aef4-7003f4f4e730,network=Network(260156eb-43c2-4baf-b4eb-6977b7f8121c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf0911e1-6c') {{(pid=98952) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 25 04:45:50.693389 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-30deb590-575c-4bc2-b594-1fb4db0bfeef tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] looking for interface given config: {{(pid=98952) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jun 25 04:45:50.694859 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-30deb590-575c-4bc2-b594-1fb4db0bfeef tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] looking for interface given config: {{(pid=98952) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jun 25 04:45:50.697529 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.driver [None req-30deb590-575c-4bc2-b594-1fb4db0bfeef tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] Attempting to detach device tapaf0911e1-6c from instance d0e9b114-f17b-4b1e-b8e1-b1a821f38974 from the persistent domain config. {{(pid=98952) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 25 04:45:50.697784 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-30deb590-575c-4bc2-b594-1fb4db0bfeef tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] detach device xml: Jun 25 04:45:50.697784 np0000003587 nova-compute[98952]: Jun 25 04:45:50.697784 np0000003587 nova-compute[98952]: Jun 25 04:45:50.697784 np0000003587 nova-compute[98952]: Jun 25 04:45:50.697784 np0000003587 nova-compute[98952]: Jun 25 04:45:50.697784 np0000003587 nova-compute[98952]: Jun 25 04:45:50.697784 np0000003587 nova-compute[98952]: Jun 25 04:45:50.697784 np0000003587 nova-compute[98952]: {{(pid=98952) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 25 04:45:50.703822 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-30deb590-575c-4bc2-b594-1fb4db0bfeef tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] looking for interface given config: {{(pid=98952) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: DEBUG nova.virt.libvirt.guest [None req-30deb590-575c-4bc2-b594-1fb4db0bfeef tempest-TaggedAttachmentsTest-9126716 tempest-TaggedAttachmentsTest-9126716-project-member] interface for config: not found in domain: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: instance-00000015 Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: d0e9b114-f17b-4b1e-b8e1-b1a821f38974 Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: tempest-device-tagging-server-715977744 Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: 2026-06-25 04:45:31 Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: 192 Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: 0 Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: 0 Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: True Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: bare Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: qcow2 Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: 0 Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: ide Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: virtio Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: pc Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: virtio Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: virtio Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: virtio Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: tempest-TaggedAttachmentsTest-9126716-project-member Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: tempest-TaggedAttachmentsTest-9126716 Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: 196608 Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: 196608 Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: 1 Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: /machine Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: OpenStack Foundation Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: OpenStack Nova Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: 33.1.0 Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: d0e9b114-f17b-4b1e-b8e1-b1a821f38974 Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: d0e9b114-f17b-4b1e-b8e1-b1a821f38974 Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Virtual Machine Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: hvm Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: 131072 Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Nehalem Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: destroy Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: restart Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: destroy Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: /usr/bin/qemu-system-x86_64 Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]:
Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]:
Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]:
Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]:
Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]:
Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: Jun 25 04:45:50.707214 np0000003587 nova-compute[98952]: